19941228  016 


. 'Hi  rill'liai  £■  UIIUUUC‘111,  C)1  LIK’ 

Requirements  for  the  Degree  of 
Master  of  Science  in  Electrical  Engineering 


Roger  L.  ( 'laypookn  .Jr..  HSEE  I 

(faptain.  I  SAf  j 

- - - ^ 


DEPARTMENT  OF  THE  AIR  FORCE 
AIR  UNIVERSITY 

AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 


Wright-Patterson  Air  Force  Base,  Ohio 


AFIT/GE/ENG/94D-02 


Multipoint  Multirate  Signal  Processing 

THESIS 

Presented  to  the  Faculty  of  the  Graduate  School  of  Engineering 
of  the  Air  Force  Institute  of  Technology 
Air  Education  and  Training  Command 
In  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of 
Master  of  Science  in  Electrical  Engineering 


Roger  L.  Claypoole,  Jr.,  BSEE 
Captain,  USAF 

December,  1994;r;  fyiftLITF 


Approved  for  public  release;  distribution  unlimited 


Acknowledgements 


I  would  like  to  thank  my  sponsor,  Dr.  Jon  Sjogren  of  the  Air  Force  Office  of 
Scientific  Research  (AFOSR/NM).  Special  thanks  go  to  my  adviser,  Dr.  Bruce  Suter, 
without  whose  help  I  would  still  be  writing.  His  assistance,  patience,  and  support 
went  far  beyond  the  call  of  duty.  I  would  also  like  to  thank  my  thesis  committee. 
Dr.  Michael  Clark  and  Dr.  Mark  Oxley,  for  their  patience  and  technical  expertise. 

Thanks  go  to  all  my  fellow  combatants  in  the  Comm/Radar  Laboratory.  They 
helped  to  make  my  time  at  AFIT  as  enjoyable  as  possible. 

Last  but  not  least,  I  would  like  to  thank  my  wife,  Lisa,  for  her  incredible 
support  and  understanding  throughout  the  thesis  writing  process. 

Roger  L.  Claypoole,  Jr. 


11 


Table  of  Contents 


Page 


Acknowledgements .  ii 

List  of  Figures  .  vi 

Abstract .  viii 

I.  Introduction .  1 

1.1  Problem  Statement .  1 

1.2  Thesis  Layout .  2 

II.  Background .  3 

2.1  Comb  Filters .  3 

2.2  Conventional  Multirate  Fundamentals  .  3 

2.2.1  Definitions .  3 

2.2.2  z-Transforms  of  Building  Blocks .  4 

2.2.3  Manipulation  of  Building  Blocks .  5 

2.2.4  Polyphase  Identities  .  6 

2.3  Perfect  Reconstruction  Multirate  Systems .  8 

2.4  Multiresolution  Wavelet  Decomposition  and  Multirate  Sig¬ 
nal  Processing .  11 

2.4.1  Wavelet  Decomposition  Fundamentals  .  11 

2.4.2  Relationship  of  the  Wavelet  Decomposition  to  Mul¬ 
tirate  Signal  Processing .  14 

III.  Theoretical  Foundations  of  Multipoint  Multirate  Signal  Processing  .  .  18 

3.1  Fundamentals  of  Multipoint  Multirate  Signal  Processing  .  18 

3.1.1  Definition  of  the  Multipoint  Decimator .  18 


111 


Page 

3.1.2  z-transform  Analysis  of  the  Multipoint  Decimator  19 

3.1.3  Polyphase  Analysis  of  the  Multipoint  Decimator  .  21 

3.1.4  Definition  of  the  Multipoint  Expander  .  23 

3.1.5  z-transform  Analysis  of  the  Multipoint  Expander  24 

3.1.6  Polyphase  Analysis  of  the  Multipoint  Expander  .  26 

3.1.7  Interconnections  of  Building  Blocks .  27 

3.1.8  Multipoint  Noble  Identities .  30 

3.1.9  Multipoint  Polyphase  Representation .  31 

3.1.10  Conditions  for  Perfect  Reconstruction  in  Multipoint 

Multirate  Systems  .  32 

3.1.11  Multipoint  Polyphase  Requirements  for  Perfect  Re¬ 
construction  .  33 

3.1.12  Design  of  Perfect  Reconstruction  Eilter  Banks  using 

the  Vector  Polyphase  Notation .  41 

3.2  Wavelet  Decomposition  with  Multipoint  Multirate  Systems  47 

IV.  A  Data  Compression  Feasibility  Study .  49 

4.1  Introduction .  49 

4.2  Energy  Redistribution  Between  Levels  of  the  Multiresolution 

Analysis .  49 

4.3  Summary .  65 

V.  Conclusions  and  Recommendations  for  Further  Study .  67 

5.1  Conclusions .  67 

5.2  Recommendations .  67 

Appendix  A.  The  Multipoint  Discrete  Fourier  Transform  Matrix  ....  69 

Appendix  B.  Sufficient  Conditions  for  Perfect  Reconstruction  in  Multi¬ 
point  Multirate  Systems .  74 


IV 


Page 

Bibliography  .  81 

Vita .  83 


V 


List  of  Figures 


Figure  Page 

1 .  Examples  of  Decimation  and  Expansion .  4 

2.  Eourier  Representation  of  Decimation  and  Expansion  .  5 

3.  Polyphase  Representation .  8 

4.  M  Channel  Multirate  Filter  Bank .  9 

5.  M  Channel  Multirate  System  with  Polyphase  Matrices .  10 

6.  Multirate  Implementation  of  the  Multiresolution  Wavelet  Decomposi¬ 
tion  .  17 

7.  Examples  of  Multipoint  Decimation  and  Expansion  .  19 

8.  Equivalent  Circuit  for  Multipoint  Decimator .  20 

9.  Equivalent  Circuit  for  Multipoint  Expander .  24 

10.  Scaling  a  Decimated  Sequence  by  a  Scalar .  28 

11.  Adding  Two  Decimated  Sequences .  28 

12.  Multiplying  Two  Decimated  Sequences .  29 

13.  Multipoint  Noble  Identities .  30 

14.  Multipoint  Polyphase  Representation .  32 

15.  Multipoint  System  with  Polyphase  Matrix  P{z)  .  34 

16.  Multipoint  Wavelet  Decomposition  Tree .  47 

17.  Daubechies  Low  Pass  Filter  Ds  for  Various  Vector  Lengths .  50 

18.  Daubechies  High  Pass  Filter  Ds  for  Various  Vector  Lengths .  51 

19.  Band  Pass  Signal  and  its  Spectrum .  52 

20.  Energy  Distribution  for  a  Bandpass  Signal .  53 

21.  Narrow  Pass  Signal  and  its  Spectrum .  55 

22.  Energy  Distribution  for  a  Narrow  Band  Signal .  56 

23.  Sinusoid  and  its  Spectrum .  57 

24.  Energy  Distribution  for  a  Sinusoid .  57 


VI 


Figure  Page 

25.  Low  Frequency  Band  Pass  Signal  and  it  Spectrum .  58 

26.  Energy  Distribution  for  a  Low  Frequency  Band  Pass  Signal .  59 

27.  High  Pass  Signal  and  its  Spectrum .  60 

28.  Energy  Distribution  for  a  High  Pass  Signal .  60 

29.  Lenna .  61 

30.  Lenna’s  Eye .  62 

31.  Spectrum  of  Lenna’s  Eye .  62 

32.  Energy  Distribution  for  Lenna’s  Eye .  63 

33.  Energy  Distribution  for  Lenna’s  Eye  with  Zero  Mean  .  64 

34.  Bandpass  Signal  with  Narrowband  Features  and  its  Spectrum  ....  65 

35.  Energy  Distribution  for  Bandpass  Signal  with  Narrowpass  Features  .  66 

36.  DFT  Tree  .  72 

37.  Partitioning  of  P{z) .  75 


vii 


AFIT/GE/ENG/94D-02 


Abstract 

This  thesis  provides  a  fundamentally  new,  systematic  study  of  multipoint  mul¬ 
tirate  signal  processing  systems.  The  multipoint  multirate  operators  are  analyzed  via 
equivalent  circuits  comprised  entirely  of  conventional  multirate  operators.  Intercon¬ 
nections  of  the  operators  are  demonstrated,  and  the  multipoint  noble  identities  are 
derived.  The  multipoint  polyphase  representation  is  presented,  and  the  M  channel 
multipoint  multirate  system  with  vector  length  N  is  presented  as  an  MN  channel 
multipoint  polyphase  system. 

The  conditions  sufficient  for  perfect  reconstruction  in  the  multipoint  multirate 
system  are  derived.  These  conditions  constrain  the  multipoint  filter  banks  to  be 
composed  of  comb  filters  generated  from  paraunitary  sets  of  conventional  filters. 
The  perfect  reconstruction  multipoint  multirate  system  is  then  combined  with  the 
multiresolution  wavelet  decomposition  to  form  the  generalized  wavelet  decomposition 
with  varying  vector  decimation  length  at  each  level. 

The  generalized  wavelet  decomposition  is  used  as  an  algorithm  to  redistribute 
the  energy  of  a  signal  throughout  the  levels  of  the  decomposition.  It  is  shown  that, 
for  band  pass  and  high  pass  signals,  significant  improvements  can  be  made  in  the 
energy  distribution.  It  is  recommended  that  this  algorithm  be  studied  as  a  front  end 
to  a  vector  quantizer  for  data  compression  applications. 


vm 


Multipoint  Multirate  Signal  Processing 


/.  Introduction 

1.1  Problem  Statement 

The  study  of  multirate  systems  has  advanced  considerably  in  recent  years.  In 
particular,  the  basic  building  blocks  have  been  explored  [2],  the  conditions  necessary 
for  perfect  reconstruction  have  been  derived  [13,  22,  19],  and  the  relationship  between 
multirate  systems  and  the  wavelet  decomposition  has  been  demonstrated  [22,  19]. 

Recently,  Khansari  and  Leon-Garcia  have  presented  a  few  of  the  fundamentals 
of  multirate  systems  with  block  sampling  [6],  or  “multipoint  multirate”.  Meanwhile, 
vector  transforms  were  introduced  for  image  coding  by  Li  [7,  8,  9],  where  input  and 
output  signals  are  finite  length  vectors  of  the  same  dimension.  Li  [7,  8,  9]  has  shown 
that  these  vector  transforms  have  an  advantage  for  image  coding  at  low  bit  rates, 
because  the  local  correlation  between  samples  can  be  exploited  more  optimally  when 
block  signals  are  used. 

Subsequently,  being  motivated  by  both  the  theoretical  arguments  of  Khansari 
and  Leon-Garcia  and  the  practical  arguments  of  Li,  Suter  and  Xia  have  completed 
a  more  systematic  presentation  of  vector  filter  banks  [23],  vector  sampling  [23],  and 
vector  wavelets  [16].  However,  there  is  still  more  research  to  be  done  in  the  area 
of  multipoint  multirate.  This  work  presents  new  insights  by  providing  a  systematic 
study  for  relating  multipoint  multirate  signal  processing  systems  to  conventional 
multirate  signal  processing  systems.  In  addition,  no  work  prior  to  this  research  has 
explored  the  idea  of  varying  vector  lengths  at  different  levels  of  the  multiresolution 
wavelet  decomposition. 
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Thus,  the  purpose  of  this  thesis  is  the  following:  generalize  the  fundamentals 
of  multipoint  multirate  signal  processing  and  apply  these  fundamentals  to  a  data 
compression  feasibility  study  based  on  the  multiresolution  wavelet  decomposition 
with  generalized  sampling. 

1.2  Thesis  Layout 

Chapter  II  will  present  the  background  of  this  thesis  by  providing  a  summary 
of  the  fundamentals  of  conventional  multirate  systems  and  wavelet  theory.  The 
basic  multirate  building  blocks,  the  decimator  and  the  expander,  will  be  analyzed, 
and  the  conditions  for  perfect  reconstruction  will  be  presented.  In  addition,  the 
fundamentals  of  the  wavelet  decomposition  will  be  discussed,  and  the  relationship 
between  the  wavelet  decomposition  and  multirate  systems  will  be  examined. 

In  Chapter  III,  the  theoretical  foundations  of  multipoint  multirate  will  be 
presented.  The  generalized  multipoint  building  blocks,  the  block  decimator  and  block 
expander,  will  be  presented  and  the  corresponding  z-transforms  will  be  derived.  A 
method  for  generating  perfect  reconstruction  multipoint  multirate  filter  banks  with 
vector  lengths  that  vary  from  stage  to  stage  will  be  presented.  The  application  of  the 
resulting  perfect  reconstruction  multipoint  multirate  systems  to  the  multiresolution 
wavelet  decomposition  will  be  studied. 

In  Chapter  IV,  a  data  compression  feasibility  study  will  be  presented.  It  will 
be  shown  that  signal  energy  can  be  redistributed  between  the  levels  of  the  multireso¬ 
lution  wavelet  decomposition,  and  that  this  redistribution  can  theoretically  increase 
the  amount  of  data  compression. 

Chapter  V  will  summarize  the  results  of  this  thesis  and  outline  recommenda¬ 
tions  for  future  research. 
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11.  Background 


2.1  Comb  Filters 

A  comb  filter  is  created  from  a  prototype  filter  via  the  mapping  z  ^  .  That 

is,  given  a  prototype  filter  Q{z),  the  z-transform  of  the  comb  filter  for  a  given  M 
is  Q{z^).  This  implies  a  certain  “pseudo-periodic”  nature  of  the  comb  filter  with 
period  M. 

Gianpaolo  Evangelista  [5]  implemented  a  transform  based  on  comb  filters  to 
separate  the  periodic  trends  in  a  signal  from  the  period-to-period  fluctuations.  This 
was  accomplished  by  matching  the  comb  transformation  M  to  the  periodicity  of  the 
input  signal. 

It  will  be  shown  in  chapter  III  that  comb  filters  naturally  arise  in  the  study  of 
multipoint  multirate  systems. 


2.2  Conventional  Multirate  Fundamentals 

2.2.1  Definitions.  The  two  building  blocks  of  multirate  processing  are  the 
decimator  and  the  expander  [17,  2].  Both  building  blocks  are  linear,  time- varying 
systems.  The  decimator  is  defined  by  the  equation 

yoin)  =  x{Mn) 


where  M  is  a  positive  integer,  and  the  expander  is  defined  by  the  equation 


ysin) 


x[nl L)  ,  if  n  is  an  integer  multiple  of  L 
0  ,  else 


where  T  is  a  positive  integer.  Decimation  by  M  =  2  retains  every  other  point  of  a 
sequence,  decimation  by  M  =  3  retains  every  third  point,  etc.  The  value  of  M  is 
the  “decimation  ratio”.  Expansion  by  T  =  2  places  a  zero  between  each  point  of 
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the  original  sequence,  expansion  by  X  =  3  places  two  zeros  between  each  point  of 
the  original  sequence,  etc.  The  value  of  L  is  the  “expansion  ratio”  [19,  2].  Figure  1 
depicts  examples  of  decimation  and  expansion  on  a  sample  sequence. 

Original  Data  Sequence 

1  2  3  4  5  6  7  8 

I — I — I — I — I — I — I — I — ► 

Resulting  Output 

13  5  7 

I - 1 - 1 - 1 - ► 

1  4  7 


1  020304050607 


1  002003004  0050'" 

I - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - ► 

Figure  1.  Examples  of  Decimation  and  Expansion,  (a)  Decimation  by  2.  (b)  Deci¬ 
mation  by  3.  (c)  Expansion  by  2.  (d)  Expansion  by  3. 

If  y{n)  is  a  decimated  version  of  x{n)  with  decimation  ratio  M,  then  the  cor¬ 
responding  notation  is  given  by  y{n)  =  (a:(n))  J,^.  Similarly,  if  y{n)  is  an  expanded 
version  of  x{n)  with  expansion  ratio  L,  then  the  corresponding  notation  is  given  by 
y{n)  =  (x(n))  As  shown  in  Figure  1,  the  block  diagram  of  decimation  by  M  is  a 
down  arrow  along  with  the  decimation  ratio  M,  and  the  block  diagram  for  expansion 
by  L  is  an  up  arrow  along  with  the  expansion  ratio  L  [17,  2]. 

2.2.2  z- Transforms  of  Building  Blocks.  The  z-transforms  of  the  basic 
building  blocks  of  conventional  multirate  were  summarized  in  the  presentation  of 
Crochiere  and  Rabiner  [2].  The  z-transform  of  an  expanded  sequence  is  defined  by 
Ye{z)  =  X{z^).  Thus,  the  z-transform  of  Ye{z)  is  composed  of  compressed  versions 
of  the  z-transform  of  the  original  sequence  centered  at  every  27r/T.  The  z-transform 


Function 

(a) 

(b) 

(C)  [JT 

(d)  [[7 
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of  a  decimated  sequence  is  given  by 


1  M-l 

=  T7  E  X(z'l"W'‘) ,  W  =  exp(-j2,^IM) 

fc=0 

The  z-transform  of  Yd  (2;)  is  composed  of  stretched  versions  of  the  original  z-transform 
centered  at  every  27r.  Figure  2  provides  an  example  of  the  Fourier  Representation 
of  expansion  and  decimation  on  a  band  limited  signal.  Figure  2c  illustrates  the 
phenomenon  of  “aliasing”  (overlap  of  adjacent  waveforms  in  the  Fourier  domain) 
caused  by  decimation.  Moreover,  when  aliasing  occurs,  it  is  not  in  general  possible 
to  recover  the  original  sequence  from  the  decimated  sequence  [2]. 


X(a3) 


L=4 


-rt/2  -n  -37t/2  0  ^/2  ^  37t/2  2n 


CO 


Figure  2.  Fourier  Representation  of  Decimation  and  Expansion,  (a)  Fourier  rep¬ 
resentation  of  original  sequence,  (b)  Fourier  representation  of  sequence 
expanded  by  T  =  4.  (c)  Fourier  representation  of  sequence  decimated  by 
M  =  2. 


2.2.3  Manipulation  of  Building  Blocks.  After  the  Fourier  representation 
of  the  decimator  and  expander  were  developed,  Crochiere  and  Rabiner  explored 
various  ways  to  connect  the  building  blocks  [2].  Using  the  notation  of  section  2.2.1, 
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the  following  equations  characterize  the  ways  in  which  decimators  can  be  combined 
together: 

a{x{n)}  Im  =  {Q:a;(n)}  Im  ,  ct  any  scalar 
{a:i(n)  +  X2{n)}  Im  =  Im  +  {x2in)}  Im 

{xi{n)  X  X2{n)]  Im  =  {a;i(n)}  Im  x  {x2(n)}  Im 

Moreover,  the  same  equations  hold  when  the  decimators  are  replaced  with  expanders. 

Cascades  of  decimators  and  expanders  can  be  exchanged  only  when  the  deci¬ 
mation  ratio  M  and  the  expansion  ratio  L  are  relatively  prime,  i.e.  gcd(M,  il)  =  1. 
When  this  requirement  on  M  and  L  holds,  the  following  equation  is  valid: 

{{a:(n)}  Im}  U  =  {{a:(n)}  U}  Im 

The  following  two  expressions  provide  the  rules  for  the  interchangeability  of 
filters  with  the  basic  multirate  building  blocks: 

{Xiz)G{z^)}iM  =  {X{z)iM}G{z) 

{xmg(2)}u  =  {j<fwu)G(zq 

These  expressions  are  known  as  the  Noble  Identities  [19].  It  is  important  to  note 
that  the  noble  identities  are  only  valid  when  G(z)  is  comprised  of  integer  powers  of 
2;.  For  example,  the  noble  identities  do  not  hold  for  G{z)  =  z~^^'^. 

2.2.4  Polyphase  Identities.  The  polyphase  representation  was  originally 
developed  by  Maurice  Bellanger  et  al  [1]  to  describe  the  equivalence  classes  that 
result  from  the  decomposition  of  a  signal.  In  the  mid  1980’s,  Martin  Vetterli  [22] 
and  P.P  Vaidyanathan  [18]  applied  the  polyphase  representation  to  the  study  of 
multirate  filter  banks. 
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Consider  the  problem  of  breaking  a  filter  h{n)  into  its  even  and  odd  polyphase 
components.  Let  the  z-transform  of  h{n)  be  H{z),  that  is,  H{z)  =  Yl'^=-oo  h{n)z~'^. 
After  separating  h[n)  into  the  two  subsequences  h{2n)  and  h{2n  +  1),  we  obtain  the 
following  expression  for  H{z): 

00  oo 

H{z)  =  h{2n  + 

n=— OO  n=— oo 

oo  oo 

n=— OO  n=— oo 

Let  Eo{z)  and  Ei{z)  represent  the  z-transforms  of  the  two  subsequences  of 
h{n),  that  is, 

OO  OO 

Eo{z)=  H‘^n)z-\  Er{z)=  ^ 

n=~oo  n=--oo 

Then,  H{z)  can  be  written  as 

H{z)  =  Eo{z^)  +  z-^Er{z^) 

These  filters  Eo{z)  and  £^1(2;)  are  the  even  and  odd  polyphase  components  of  the 
filter  H{z). 

Figure  3  demonstrates  how  the  polyphase  components  of  a  filter  can  be  substi¬ 
tuted  into  a  multirate  system.  Figures  3a-3c  demonstrate  the  replacement  of  H{z) 
with  H{z)  =  Eo{z'^)  -b  z~^E\{z'^).  Applying  the  noble  identities  to  the  polyphase 
components  results  in  the  block  diagram  shown  in  figure  3d.  This  block  diagram  is 
also  referred  to  as  the  polyphase  representation  of  H(z). 

In  general,  the  polyphase  representation  of  a  filter  H(z)  for  an  arbitrary  deci¬ 
mation  ratio  M  is  given  by 

M-l 

H{z)  =  Eoiz^)  +  z-^E^{z^)  +  •  •  •  +  z-^^-^^Em-i{z^)  =  E  ^~'Ei{z^) 

i=0 
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(a)  (b) 


(c)  (d) 

Figure  3.  Polyphase  Representation,  (a)  Original  System,  (b)  Substitution  of 
Polyphase  Components  for  H{z).  (c)  Splitting  the  Decimator.  (d)  Ap¬ 
plication  of  Noble  Identities 

CO 

where  Ei{z)  =  h{Mn  -|-  i)z~'^. 

n=— CO 

The  polyphase  representation  can  also  be  derived  for  expanders  instead  of 
decimators.  H{z)  is  still  written  in  terms  of  its  polyphase  components,  except  the 
second  noble  identity  is  used  to  pass  the  polyphase  components  back  through  the 
expanders. 

2.3  Perfect  Reconstruction  MuHirate  Systems 

A  multirate  filter  bank  is  an  M-channel  system  as  shown  in  Figure  4.  The 
set  of  filters  {Ho[z)  ■  ■  ■  is  called  the  “analysis  bank”  and  the  set  of  filters 

{Fo{^)  •  •  •  Fm-i{z)}  is  called  the  “synthesis  bank”  [20,  22,  17]. 

It  is  possible  to  choose  the  analysis  and  synthesis  filters  such  that  the  output 
of  the  multirate  system  is  a  delayed  (and  possibly  scaled)  version  of  the  input.  Such 
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Figure  4.  M  Channel  Multirate  Filter  Bank 


a  system  is  said  to  exhibit  the  “Perfect  Reconstruction”  property,  or  the  “PR” 
property.  This  property  was  first  studied  by  Smith  and  Barnwell  [13]  and  Mintzer 
[11]  for  the  two  channel  system,  and  later  extended  to  the  M  channel  system  by 
Vetterli  [22]  and  Vaidyanathan  [18]. 

In  an  M  channel  multirate  system,  each  of  the  filters  Hi{z)  and  Fj{z)  are 
written  in  terms  of  their  M  polyphase  components  Eij{z)  and  Rij{z).  That  is, 

M-l 

Hi(z)  = 

1=0 

M-l 

F,{z)  =  x: 

i=0 

The  polyphase  components  of  the  analysis  filters  can  be  placed  into  a  polyphase 
matrix  E{z^),  where  the  row  of  E(z^)  is  composed  of  the  polyphase  components 
of  Hi[z).  In  similar  fashion,  the  polyphase  components  of  the  synthesis  filters  make 
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up  the  columns  of  the  polyphase  matrix  R{z^).  These  polyphase  matrices  are: 


EoAz^)  •• 

••  Eo,m-i{z^) 

II 

E,Az^)  ■■ 

■■  E,,m-i{z^) 

1— 1 

1 

Em-x,i{z^)  ■■ 

••  Em-1, M-i{z^) 

Ro,i{z^)  ■■ 

Rq^m-\{z^) 

II 

RhA^^)  ■■ 

••  Ri,m-i{z^) 

.  RM-lfl{z^) 

1— t 

1— 1 

1 

1 

After  application  of  the  noble  identities  to  these  polyphase  matrices,  the  M 
channel  multirate  system  shown  in  figure  4  can  be  redrawn  as  the  M  channel  polyphase 
system  shown  in  figure  5. 


Figure  5.  M  Channel  Multirate  System  with  Polyphase  Matrices 
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In  this  polyphase  representation,  the  system  exhibits  perfect  reconstruction 
[19]  if  and  only  if 

P{z)  =  R{z)E{z)  ^  cz-^'^ 

where  c  is  some  scalar,  mo  is  a  nonnegative  integer  and  r  G  {0, 1,  •  ■  •  ,  M  -  1}.  Note 
that  when  r  =  0,  the  equation  becomes  P{z)  =  R{z)E{z)  =  cz~'^°Im-  In  this  case, 
R{z)  must  be  chosen  such  that  R{z)  =  In  general,  the  inverse  of  E{z) 

may  not  exist.  If  E~^{z)  does  exist,  it  may  not  be  realizable  with  finite  impulse 
response  (FIR)  filters,  even  if  E{z)  is  entirely  composed  of  FIR  filters.  However,  a 
special  case  arises  when  E(z)  is  chosen  to  be  “paraunitary”. 

A  matrix  E{z)  is  paraunitary  if  E~^{z)  =  E(z),  where  E{z)  =  E^{z~^).  That 
is,  E{z)  is  the  complex  conjugate  transpose  of  E{z)  with  replaced  by  z~'^,  and 
E{z)E(z)  =  I.  Clearly,  if  E{z)  is  paraunitary,  then  R{z)  can  be  chosen  to  equal 
E{z)  and  the  resulting  P{z)  will  equal  the  identity.  For  a  maximally  decimated  filter 
bank,  the  perfect  reconstruction  property  is  equivalent  to  biorthogonality  [4]. 

When  E{z)  is  paraunitary  and  R{z)  =  E{z),  then  the  resulting  system  will 
exhibit  the  PR  property  with  the  additional  advantage  that,  if  the  analysis  bank 
is  composed  of  FIR  filters,  then  the  synthesis  bank  will  also  be  composed  of  FIR 
filters.  Thus,  the  special  case  of  a  paraunitary  filter  bank  is  very  useful  in  the  design 
of  perfect  reconstruction  multirate  systems  [20,  22].  Moreover,  if  an  orthonormal 
basis  can  be  generated  by  using  a  tree  structure  (such  as  in  the  Discrete  Wavelet  De¬ 
composition),  then  the  basis  can  also  be  generated  by  a  paraunitary  tree  [14].  Thus, 
a  close  relationship  exists  between  paraunitariness  and  orthogonal  decompositions. 

2.4  MuUiresolution  Wavelet  Decomposition  and  Multirate  Signal  Processing 

2.4.1  Wavelet  Decomposition  Fundamentals.  A  recurring  theme  in  the 
multiresolution  wavelet  decomposition  is  the  successive  projection  of  a  function 


0  Im-t 
z-^Ir  0 
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into  “smaller”  orthogonal  subspaces  (see,  for  example,  “Daubechies  Ten  Lectures 
on  Wavelets”  [3]). 

Let  ^  sequence  of  nested  subspaces  constructed  in  L^(3?)  such  that 

Vm  c  Kn-1  me  Z. 

Let  /  be  a  function  which  exists  in  the  subspace  Kn-i  •  Let  Pm  be  the  projection 
operator  which  takes  the  function  /  G  Wx-i  into  the  nested  subspace  Vm  C  Kn-i- 
This  projection  operator  eliminates  the  portion  of  /  which  is  not  in  Vm-,  while  it  does 
not  disturb  the  portion  of  /  which  lies  in  Vm-  Clearly,  successive  application  of  the 
same  projection  operator  does  not  effect  the  result,  i.e.,  {PmY  —  Pm  V  G  Z'^ . 

Let  {Wm}me2  be  another  sequence  of  nested  subspaces  such  that  Wm  C 
Vm-i  V  m  e  Z.  Further,  let  the  span  of  U  Wm  equal  Vm-i,  and  let  Vm  and 
Wm  be  orthogonal  subspaces.  Thus,  Kn-i  =  Vm  ®  Wm  and  Vm  H  Wm  =  4'-  Let 
Qm  =  1  —  Pm  (where  I  is  the  identity  operator)  be  the  orthogonal  projection  op¬ 
erator  which  takes  the  function  /  into  the  nested  subspace  Wm  C  Kn-i-  Thus, 
PmQm  =  QmPm  =  0)  where  0  is  the  zero  operator. 

Let  the  set  of  functions  {4m,i}iez  be  an  orthonormal  basis  for  Vm-,  and  let  the 
set  of  functions  {'4m,i]iez  be  an  orthonormal  basis  for  Wm-  Then,  the  projection  of 
/  into  Vm  can  be  expanded  in  terms  of  the  basis  functions  for  Vm,  and  the  projection 
of  /  into  Wm  can  be  expanded  in  terms  of  the  basis  functions  for  Wm,  resulting  in 
the  following  equalities: 

[Pmf]{x)  =  Y^Cm{l)4m,l{x) 

I 

[Qmf]ix)  =  Yl*^m{l)4m,l{^) 

I 

To  find  a  particular  coefficient  Cm{l),  one  takes  the  inner  product  of  Pmf  with 
the  basis  function  The  inner  product  of  two  arbitrary  real  valued  functions  / 
and  g  is  defined  by 

/OO 

f{t)g{t)dt 

-OO 
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The  inner  product  of  Pmf  and  is  written  as  {PmfAm,!)-  The  inner  product  of 
any  two  basis  functions  is  =  ^k,i,  since  the  basis  functions  are  orthonor¬ 

mal.  Therefore,  a  particular  coefficient  is  found  as  follows: 


—  {^k  ^m{k')^m,kt  4^m,l) 

—  Sfc  An(^)  {^m,ki  ^^771,1) 

=  Cfn(0 

We  assume  that  the  signal  /  exists  entirely  in  the  space  Ki-i  for  some  m  ^  Z. 
That  is,  Pm-if  =  /,  and  /  can  be  completely  represented  as  a  linear  combination 
of  the  basis  functions  for  Vm-i-  However,  since  Pm  +  Qm  =  I?  we  can  write 

Pm-lf  —  Pmf  +  Qmf 

Therefore,  any  particular  decomposition  coefficient  in  Vm  can  be  written  as 

Cm(0  ~  {Pmf)4^m,l} 

=  {{Pm-lf  -  Qmf)7fm,l) 

—  {Pm—lfifm,l)  {Qmfffmj) 

—  {Pm—lfifmj} 

This  last  equality  holds  because  Qmf  is  in  Wm,  fm,i  is  a  basis  function  for  Vm-, 
and  Vm  and  Wm  are  orthogonal,  so  {Qmf,fm,i)  —  0. 

If  Pm-lf  is  expanded  in  terms  of  the  basis  functions  for  Vm-i  and  the  results 
substituted  into  the  expression  for  Cm{l),  then 

Cm(0  ~  {Pmfifmfl 

~  ((Sn  l(n)^m— l,n))  *^771,/) 

~  —  1  (n)  (<^^771— 1,71,  <^771, ;) 
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In  similar  fashion,  it  can  be  shown  that 


—  'y  1  1  (^)  (*^m— l,w; '0TO,/) 

n 

For  the  case  of  discrete  wavelet  filters,  the  inner  product  of  a  basis  function  for 
I4i-i  and  a  basis  function  for  Vm  can  be  written  as  an  FIR  filter,  that  is 

(*^m— l,rn  4^m,l)  ^  2/) 

{4'm—l,ni  V’m,/)  —  9  2/) 

where  the  discrete  wavelet  filters  h'  and  g'  are  independent  of  the  decomposition  level 
m.  Thus,  if  the  coefficients  Cm_i(n)  of  /  G  Kn-i  are  known,  then  the  coefficients  of 
the  projection  of  /  into  Vm  and  Wm  are 

Cm(0  =  IlnCm-i{n)h'{n-2l) 
dm{l)  =  llnCm-i{n)g'{n-2l) 

where  Cm(/)  are  the  coefficients  of  Pmf  G  Vm  and  dm{l)  are  the  coefficients  of  Qmf  G 

Wm. 

Once  the  coefficients  of  the  projection  of  /  into  Vm  are  known,  the  function  can 
be  further  decomposed  into  the  orthogonal  subspaces  of  Ki,  namely  14i+i  and  Wm+i, 
with  the  same  formulas,  since  the  discrete  wavelet  filters  h'  and  g'  are  independent  of 
the  decomposition  level  m.  This  leads  to  a  recursive  decomposition  routine,  breaking 
/  down  into  its  projections  into  smaller  orthogonal  subspaces.  This  recursive  algo¬ 
rithm  is  the  heart  of  the  modern  multiresolution  wavelet  decomposition  algorithm 
[12,  3,  10]. 

2.4.2  Relationship  of  the  Wavelet  Decomposition  to  Multirate  Signal  Process¬ 
ing.  As  shown  in  section  2.4.1,  at  decomposition  level  m  the  coefficients  Cm{n) 
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can  be  written  in  terms  of  the  coefficients  at  the  next  higher  level  as  follows: 


Cm(^)  —  ^  ^  (fc)/t  (A:  2n) 

k 

where  h'[n)  is  a  filter  which  satisfies  the  wavelet  decomposition  requirements,  i.e., 

h  {tI  2/)  —  4^m,l) 

A  new  filter  h{n)  can  be  created  which  is  a  “flipped”  version  of  the  filter  h'[n), 
that  is,  h{n)  =  h'{—n).  Substituting  this  filter  h{n)  into  the  expression  for  the 
decomposition  coefficients  yields: 

~  ^  A:) 

k 

Note  that,  if  y{n)  =  {x{n))  I2,  then  y{n)  =  x{2n).  Thus,  Cm{n)  can  be  written  as 

Cm{n)  =  Y,  ^rn-i{k)  {h{n  -  k))  i2 

k 

In  section  2.2.3,  we  saw  that  a{x{n))iM  =  {ctx{n))iM,  where  a  is  any  scalar. 
Hence,  Cm(u)  becomes 


Cm(w)  =  Y  {cm-i{k)h{n  -  k))  i2 
k 


Also  in  section  2.2.3,  we  saw  that  {xi(n)+a:2(^)}  Im  =  iM  +  {x2in')}  Im  ■ 

Hence,  Cm{n)  can  be  written  as 


Cm(^)  — 


Cm—\{k^h{n 
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Also  note  that,  for  two  signals  /(n)  and  g{n),  their  discrete  convolution  is  given 


by 


f{n)^g{n)  =  J2f{k)g{n-k) 


Thus,  the  expression  for  the  decomposition  coefficients  Cm{n)  can  be  simplified  as 


c„(n)  =  (c„_i(n)  *  h(n))  i2 


In  similar  fashion,  the  coefficients  Cm-i(n)  projected  into  the  space  are 
given  by  the  expression 


dm{n)  =  (c^_i(n)  *^(n))  J.2 

where  g{n)  =  g'{—n)  and  g'{n)  satisfies  the  wavelet  decomposition  requirement 

g  2/)  = 

The  filters  h{n)  and  g{n)  are  traditionally  chosen  to  be  low  pass  and  high  pass 
filters,  respectively.  Thus,  the  coefficients  Cm{n)  are  referred  to  as  the  “low  pass 
coefficients”  or  “coarse  coefficients”,  and  the  coefficients  dm{n)  are  referred  to  as  the 
“high  pass  coefficients”  or  “detail  coefficients”  [3] . 

With  the  above  results,  the  decomposition  of  Cm-i(n)  into  Cm{n)  and  dm{n)  can 
be  viewed  as  a  2-channel  multirate  system,  with  the  analysis  bank  comprised  of  the 
wavelet  filters  h  and  g.  If  /i  and  g  satisfy  the  wavelet  decomposition  requirements, 
then,  in  terms  of  multirate  theory,  the  filters  h  and  g  form  a  perfect  reconstruction 
set  [19,  12].  Thus,  the  recursive  wavelet  decomposition  algorithm  can  be  viewed  as  a 
cascade  of  2-channel  multirate  filters,  as  shown  in  figure  6.  This  figure  demonstrates 
the  realization  of  the  wavelet  decomposition  as  a  perfect  reconstruction  multirate 
system. 
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Figure  6.  Multirate  Implementation  of  the  Multiresolution  Wavelet  Decomposition 
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III.  Theoretical  Foundations  of  Multipoint  Multirate  Signal 

Processing 

3.1  Fundamentals  of  Multipoint  Multirate  Signal  Processing 

The  fundamental  building  blocks  of  multipoint  multirate  are  the  multipoint 
decimator  and  the  multipoint  expander.  These  building  blocks  are  modified  from 
the  conventional  multirate  building  blocks  (reference  section  2.2.1)  such  that  they 
operate  on  multiple  points  of  data  (data  vectors)  simultaneously.  This  is  why  mul¬ 
tipoint  multirate  is  also  referred  to  as  “vector  sampling”  [6]. 

For  example,  instead  of  retaining  every  other  point  as  in  conventional  decima¬ 
tion  by  two,  the  multipoint  decimator  could  retain  the  first  two  of  every  four  points 
(or  the  first  two  points  of  each  data  vector  of  length  four).  This  would  correspond  to 
multipoint  decimation  by  (2,2).  In  general,  multipoint  decimation  by  (M,  N)  retains 
the  first  N  points  from  every  set  of  length  MN.  M  is  the  decimation  ratio,  and  N  is 
the  decimation  vector  length  [6].  Multipoint  expansion  is  defined  in  a  similar  man¬ 
ner.  Multipoint  expansion  by  {L,N)  places  {L  -  l)N  zeros  (or,  equivalently,  L  -  I 
zero- vectors  each  of  length  N)  between  each  set  of  N  data  points  [6].  See  Figure  7  for 
examples  of  multipoint  decimation  and  expansion.  Note  that  multipoint  decimation 
or  expansion  by  (M,  1)  is  equivalent  to  conventional  decimation  or  expansion  by  M. 

3.1.1  Definition  of  the  Multipoint  Decimator.  The  equation  of  the  mul¬ 
tipoint  decimator  can  be  written  as  y(n)  =  x{[n/N\MN  +  nMODN),  where  the 
floor  function  of  k,  denoted  [fcj,  is  the  greatest  integer  <  k.  This  expression  for  the 
multipoint  decimator  is  comprised  of  two  fundamental  pieces.  The  first,  [n/N\MN, 
accounts  for  the  periodicity  in  a  decimated  signal.  The  original  sequence  is  blocked 
into  vectors  of  length  MN,  and  then  these  vectors  are  mapped  into  y{n)  with  period 
N.  The  second  term,  nMODA^,  maps  the  first  N  elements  of  every  length  MN  input 
vector  into  the  output  y{n).  Thus,  as  n  increases,  the  first  term  indexes  the  length 
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Original  Data  Sequence 

1  2  3  4  5  6  7  8  9  10  11  12  13  14 

I - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - h 


Function 


Resulting  Output 

1  2  3  7  8  9  13  14 

I — I — I — I — I — I — I — I- 


(b) 


1  2  7  8  13  14 

I - 1 - 1 - 1 - 1 - h 


(C) 


1  2  3  0  0  0  4 


8 


(d) 


12000034000066 
I - 1 - 1 - 1 - \ - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - H 


Figure  7.  Examples  of  Multipoint  Decimation  and  Expansion,  (a)  Decimation  by 
(2,3).  (b)  Decimation  by  (3,2).  (c)  Expansion  by  (2,3).  (d)  Expansion 
by  (3,2). 


MN  data  vectors,  and  the  second  term  steps  through  the  first  N  points  of  data  in 
each  vector. 

Note  that,  when  N  =  I,  this  equation  reduces  to  y{n)  —  x{Mn).  This  is  the 
equation  describing  the  single  point  decimator  [2]  which  was  discussed  in  section  2.2. 


3.1.2  z-transform  Analysis  of  the  Multipoint  Decimator.  In  the  z-transform 
domain,  the  equivalent  circuit  of  multipoint  decimation  by  (M,  N)  is  shown  in  figure 
8.  This  equivalent  circuit  blocks  the  original  sequence  into  vectors  of  length  MN, 
but  only  retains  the  first  N  points  of  every  vector.  This  is  multipoint  decimation  by 
{M,N). 

The  building  blocks  in  the  equivalent  circuit  of  figure  8  are  all  conventional 
decimators  and  expanders  which  were  discussed  in  section  2.2.  As  such,  the  z- 
transform  of  the  multipoint  decimator,  which  will  be  denoted  as  {X{z))  is: 


X{z) 


M,N 
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Figure  8.  Equivalent  Circuit  for  Multipoint  Decimator 


where  Wj^;^  =  exp{—j2'!rk/{MN)).  This  equation  was  derived  as  follows.  Let  Ui{z) 
be  the  output  of  the  decimator  in  the  channel  of  the  equivalent  circuit.  Then, 


Uiiz)  =  (X{z)z^)iMN 


MN-1 


MN 


£  X{z^W^;^)z^Wj 


Ik 

MN 


k=0 


Let  Vi{z)  be  the  output  of  the  expander  in  the  channel  of  the  equivalent  circuit. 
Then, 


vi{z)  =  mz))u 


1 


MN-1 


X{zmnW^j^)zmnW‘^^ 

k=0 

MN-1 

k-0 


IN 


MN 

1 

MiV 


Now,  the  output  of  the  equivalent  circuit,  X{z),  is 


X{z) 


N-1 

E 


1=0 


20 


N-1  (  1  MiV-1  \ 

=  E  (jgjv  E 

1  MN-lN-1 

=  TTT?  E  E 

fc=o  i=o 

1  MN-l  /N-1  \ 

=  E  (e^'<->'^S~)^(^”<.) 

In  the  last  equation,  the  term  inside  the  large  parentheses  is  independent  of 
the  input  X(z)-,  it  is  only  a  function  of  M,N,  and  k.  This  term  will  be  called  the 
“Decimation  Scaling  Function”,  and  it  will  be  denoted  AD^pf.  Hence,  the  output 
of  the  multipoint  decimator  is  given  by 

1  MN-l 

X{z)  M,N  =  X] 

This  equation  demonstrates  that  multipoint  decimation  with  a  decimation  ratio  of 
M  and  a  vector  length  of  N  creates  MN  —  1  alias  terms,  whereas  conventional 
decimation  with  a  decimation  ratio  of  M  creates  only  M  —  1  alias  terms. 

3.1.3  Polyphase  Analysis  of  the  Multipoint  Decimator.  As  stated  above, 
the  multipoint  decimator  blocks  the  data  into  vectors  of  length  MN,  but  only  retains 
the  first  N  points  of  each  vector.  As  shown  in  figure  8,  this  blocking  is  performed 
by  a  bank  of  N  conventional  decimators,  each  with  decimation  ratio  MN. 

The  input  to  the  decimator  in  the  first  channel  of  the  equivalent  circuit  is  x{n), 
so  the  output  of  this  decimator  is  given  by  y{n)  =  x{MNn).  As  shown  in  section 
2.2.1,  the  MN  polyphase  representation  of  any  signal  x{n)  is 

MN-l 

X{z)=  Ek{z^^)z-'^ 

k=Q 
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where  Ek{z)  —  Y^^x{MNn  +  k)z~'^  =  efc(n)2;“".  Thus,  the  output  of  the  first 

decimator  in  the  equivalent  circuit  is  y{ri)  =  eo(n),  where  eo(n)  is  the  first  of  the 
MN  polyphase  components  of  the  input  signal  x{n). 

In  similar  fashion,  the  input  to  the  decimator  in  the  channel  of  the  equiv¬ 
alent  circuit  is  z^X[z).  This  can  be  written  in  terms  of  its  polyphase  components 
E'{z)  (where  the  prime  demonstrates  that  these  are  not  the  polyphase  components 
of  X(z)  from  above)  as  follows: 

MN-l 

z‘X(z)=  Y. 


However,  by  substituting  the  polyphase  representation  for  X(z)  into  ^  ^X{z),  the 
following  equivalent  expression  is  derived: 

/MN-l  \ 

z^x{z)  = 

MN-l 

/=0 

By  making  the  change  of  variable  m  =  I  —  k,  we  have 
MN-l-k 

Z^X{Z)  =  ^  Em+k{z^^)z-'^ 

171=— k 

MN-l-k  MN-l 

Erp  (  MN\  —m  I  \  '  T?  (  MN\  —m—MN 

Em-\-k\Z  jZ  T  /  ^  Ej:ji^}^j^]\/Jj\jyz  jZ 

m=0  m=MN—k 


But  the  polyphase  representation  of  z^X{z)  in  terms  of  its  own  polyphase  compo¬ 
nents  is 


MN-l 

z‘^X(z)=  Y:  E'Jz^'^)z- 


m=0 

By  equating  this  expression  for  z’^X(z)  with  the  above  expression  for  z'^X^z),  we 
find  that  Eq{z)  =  Ek{z).  Decimation  by  MN  in  each  channel  of  the  equivalent 
circuit  retains  only  the  first  polyphase  component  of  the  input  signal,  so  the  output 
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of  the  decimator  in  the  channel  of  the  equivalent  circuit  will  be  the  polyphase 
component  of  the  input  signal  X{z). 

These  signals  are  subsequently  expanded  by  N  and  multiplied  by  so  the 
final  output  Yk{z)  of  each  channel  in  the  equivalent  circuit  is  Yk{z)  =  z~^Ek[z^). 
Forming  the  summation  of  these  Yk{z)  yields  the  polyphase  decimation  expression  for 
the  output  of  a  multipoint  decimator,  which  is  equivalent  to  the  decimation  relation 
derived  in  section  3.1.2.  This  alternate  representation  with  decimation  ratio  M  and 
vector  length  N  is  given  by: 

X{z)  =  z-^Ek{z^) 

k—0 

In  this  polyphase  expression  for  the  multipoint  decimator,  the  Decimation 
Scaling  Function  has  served  to  eliminate  the  higher  order  polyphase  components  in 
each  channel  of  the  equivalent  circuit.  The  resulting  expression  is  the  first  N  of 
the  MN  polyphase  components  of  the  input  signal  x(n),  each  component  expanded 
by  N  and  shifted  an  appropriate  amount.  In  general,  the  original  signal  x{n)  is 
not  recoverable  because  the  highest  (M  —  1)N  polyphase  components  have  been 
discarded. 


3.1.4  Definition  of  the  Multipoint  Expander.  The  equation  of  the  multi¬ 
point  expander  can  be  written  as 


y{n) 


X  ( [n/{NM)\  N  nMOD(MiV))  ,  if  nMOD{MN)  <  N 
0  ,  else 


This  expression  also  has  two  fundamental  pieces.  The  first,  [n/{NM)\N, 
controls  the  periodicity  of  the  multipoint  expansion.  The  input  signal  is  blocked 
into  vectors  of  length  N,  and  this  term  indexes  those  vectors.  The  second  term, 
nMOD(MiV),  indexes  the  points  of  data  inside  the  vector.  When  this  term  is  less 
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than  N,  it  maps  the  N  points  of  the  length  N  data  vector  into  the  output  y{n). 
Then,  for  N  <  nMOD(MiV)  <  MN  -  1,  a  set  of  {M  -  1)N  zeros  are  mapped  into 
the  output.  Thus,  as  n  increases,  consecutive  blocks  of  length  N  of  the  input  signal 
are  mapped  to  the  output  with  M  —  1  zero- vectors  of  length  N  inserted  between  the 
data  vectors. 

Note  that,  when  the  expansion  vector  length  =  1,  this  equation  reduces  to 


xinjM) 

0 


,  if  n  is  divisible  by  M 
,  else 


This  is  the  equation  describing  the  conventional  expander  [2],  which  was  discussed 
in  section  2.2. 


3.1.5  z-transform  Analysis  of  the  Multipoint  Expander.  In  the  z-transform 
domain,  the  equivalent  circuit  of  the  multipoint  expander  with  expansion  ratio  M 
and  vector  length  N  is  shown  in  figure  9.  This  equivalent  circuit  blocks  the  original 
sequence  into  vectors  of  length  N  and  then  inserts  M  —  1  zero-vectors  of  length  N 
between  the  data  vectors. 


Figure  9.  Equivalent  Circuit  for  Multipoint  Expander 
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The  building  blocks  in  the  equivalent  circuit  of  figure  9  are  all  conventional 
decimators  and  expanders  which  were  discussed  in  section  2.2.  As  such,  the  z- 
transform  of  the  multipoint  expander,  which  will  be  denoted  as  (A'(^))  is: 


M,N 


1 

iV 


N-1 


E 


X{z"W^) 


This  equation  was  derived  as  follows: 

Let  Ui{z)  be  the  output  of  the  decimator  in  the  channel  of  the  equivalent 
circuit.  Then, 


U,{z)  = 

k=0 


Let  Vi(z)  be  the  output  of  the  expander  in  the  channel  of  the  equivalent 
circuit.  Then, 


Vi{z)  =  {Ui{z))Un 

=  Ui{z^^) 

i  ^  II rk\ 

=  ^  E  ^ 

k=0 

k=o 

Now,  the  output  of  the  equivalent  circuit,  X{z),  is 

1=0 

=  E  E 

1=0  k=0  / 
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1  N-lN-1  ^ 

A:==0  Z=0 

k=o  Vfco  / 


The  term  inside  the  large  parentheses  is  again  independent  of  the  input  X(z), 
and  is  only  a  function  of  M,iV,  and  k.  This  term  will  be  called  the  “Expansion 
Scaling  Function”,  and  it  will  be  denoted  It  can  be  used  to  simplify  the 

equation  of  the  multipoint  expander  to 


X(z) 


«,«  =  4  E 

A;=0 


In  the  next  section,  it  will  be  shown  that  this  scaling  function  is  a  byproduct  of  the 
blocking  nature  of  the  multipoint  expander.  It  is  important  to  note  that  there  is  no 
aliasing  in  the  multipoint  expander,  and  the  original  signal  is  completely  recoverable 
from  the  expanded  signal. 


3.1.6  Polyphase  Analysis  of  the  Multipoint  Expander.  As  stated  above, 
the  multipoint  decimator  blocks  the  data  into  vectors  of  length  N,  and  then  places 
M  —  1  zero- vectors  of  length  N  between  the  blocks  of  data.  As  shown  in  figure  9,  this 
blocking  is  performed  by  a  bank  of  N  conventional  decimators,  each  with  decimation 
ratio  N. 

This  data-blocking  bank  of  decimators  is  similar  to  the  blocking  nature  of  the 
decimator,  except  the  data  are  blocked  into  vectors  of  length  N  and  all  the  blocks 
are  retained.  Thus,  with  minor  modification  to  the  derivation  of  section  3.1.1,  the 
output  of  the  decimator  in  the  channel  of  the  equivalent  circuit  will  be  the 
polyphase  component  of  the  input  signal  X{z). 

These  polyphase  components  are  subsequently  expanded  by  MA’  and  multi¬ 
plied  by  z~^,  so  the  final  output  Yk{z)  of  each  channel  in  the  equivalent  circuit  is 
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Yk{z)  —  z~^ Ek{z^^).  Forming  the  summation  of  these  Yk{z)  yields  the  polyphase 
expansion  expression  for  the  output  of  a  multipoint  expander,  which  is  equivalent  to 
the  expansion  relation  derived  in  section  3.1.4.  This  alternate  representation  with 
expansion  ratio  M  and  vector  length  N  is  given  by: 

X{z)  -  e'  z-’‘Ekiz^^) 

k=0 

In  this  polyphase  expression  for  the  multipoint  decimator,  the  Expansion  Scal¬ 
ing  Function  has  served  to  eliminate  the  higher  order  polyphase  components  in  each 
channel  of  the  equivalent  circuit.  The  resulting  expression  is  comprised  of  all  N  of 
the  N  polyphase  components  for  the  input  signal  x{n).  The  components  have  been 
expanded  by  MN  and  shifted  to  comprise  the  complete  expanded  signal.  The  orig¬ 
inal  signal  is  completely  recoverable  by  reblocking  the  expanded  signal  into  vectors 
of  length  MN  and  then  only  retaining  the  first  N  points  of  each  block.  As  discussed 
in  section  3.1.2,  this  inverse  operation  is  multipoint  decimation. 

3.1.7  Interconnections  of  Building  Blocks.  This  section  provides  proofs 
for  the  basic  interconnection  properties  of  the  multipoint  decimator  and  expander. 
These  interconnection  properties  are  depicted  (for  the  multipoint  decimator)  in  fig¬ 
ures  10,11,  and  12,  The  first  two  properties  demonstrate  that  the  multipoint  building 
blocks  are  linear  operators. 

3. 1.7.1  Scaling  a  Decimated  Sequence  by  a  Constant  a.  A  sequence 
can  be  multiplied  by  a  scalar  prior  to  or  after  multipoint  decimation;  the  results  are 
identical.  See  figure  10. 


r(z) 


^  [-^(^)]  Im,N 


a 


1 

MN 


MN-l 


E 
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1  MN-1  /W-l  ,  \  , 

=  E  (E  K(^”<a,)] 

=  [a-^(^)]  iM,N 

x(n)  ^  I  m,n  y(n)  =  X(n)  ^>— » j  m,n  —  y(n) 
a  ^ 

Figure  10.  Scaling  a  Decimated  Sequence  by  a  Scalar 

3. 1.7. 2  Adding  Two  Decimated  Sequences.  Multipoint  decimation 
can  be  performed  on  the  sum  of  two  sequences,  or  the  decimation  can  be  performed 
prior  to  the  summation.  In  either  case,  the  results  are  identical.  See  figure  11. 

Yiz)  =  [Xi{z)+X2{z)]iM,N 

1  MN-1  /N-1  ,  \  ,  , 

=  E  (E  +  x,(z^w^n)_ 

.  MN-1  /N-1  ,  „  \ 

=  E  (j:^‘'^''^MNjXi{z^w!;,^) 

1  MN-1  /N-1  \ 

+  m  £  (S 

=  [-^l(^)]  Im,N  +  [X2{z)]  Im,N 


Figure  11.  Adding  Two  Decimated  Sequences 


3. 1.7.3  Multiplying  Two  Decimated  Sequences.  Two  sequences  may 
be  multiplied  point  by  point  prior  to  or  after  multipoint  decimation.  The  results  are 
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the  same  either  way.  To  prove  this,  the  following  relationship  is  required: 

If  u{n)  —  x{n)  X  d{n),  then  where  *  denotes  convolution. 

Therefore,  if 

y{n)  =  [x(n)  X  d{n)]  Im,n 

then,  in  the  Fourier  domain. 


Y{en  =  [X{en*D{en]iM,N 


MN-l  /N-l 


MN 


k=0  \ 1=0 


and,  since  convolution  is  linear  in  each  variable  (i.e.  bilinear). 


y(e^'^)  = 


MN-l  /N-l 


MN 


k=Q  \ 1=0 


=  [V(e'")]  iM,N  *  [^(e'")]  1m, 


k  \ 
MN) 


\N 


Thus,  in  time, 


y{n)  =  [x(n)]  Im,n  x  [d{n)]  Im,n 


x(n) 


M,N 


■y(n) 


d(n) 


x(n) 


d(n) 


M,N 


y(n) 


M,N 


Figure  12.  Multiplying  Two  Decimated  Sequences 


These  three  equalities  all  hold  true  when  multipoint  expansion  is  substituted 
for  multipoint  decimation. 
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3.1.8  Multipoint  Noble  Identities.  The  Noble  Identities  for  multipoint 
decimators  and  expanders  are  depicted  in  figures  13a  and  13b.  The  proofs  for  these 
identities  are  presented  below: 


(a) 

(b) 


X(z) 

X(z) 


Y(z) 

Y(z) 


X(z) 

X(z) 


Figure  13.  Multipoint  Noble  Identities,  (a)  First  Noble  Identity,  (b)  Second  Noble 
Identity 


3. 1.8.1  The  First  (Decimation)  Noble  Identity  (Figure  13a). 

Y(z)  =  \X(z)G{2^^)]  Un 

1  MN-1  /N-1  ,,  \ 

1  MN-l  /N-1  \ 

=  G(z'")  [X(2)J  1„,„ 


3. 1.8. 2  The  Second  (Expansion)  Noble  Identity  (Figure  13b). 


Y{z)  =  [X{z)G{z’^)]]m,n 


N-1  /N-1 


N 


E  E  X{z^W^)G{z^^W^^) 


k-O  \  l-O 


=  4  E  f  E  X{z^W^)G{z^^) 

^  k=0  \  1=0  / 

=  G{z^^)[X{z)]U,n 
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3.1.9  Multipoint  Polyphase  Representation.  In  order  to  develop  the  mul¬ 
tipoint  polyphase  identities  for  a  filter  H(z),  the  filter  must  be  decomposed  into 
its  MN  conventional  polyphase  components.  The  resulting  polyphase  equation  for 
multipoint  decimation  with  decimation  ratio  M  and  vector  length  N  is  given  by 

MN-l 

H{z)=  ^ 

k=0 

where 

CX) 

Ek{z)=  E  h{MNn  +  k)z-'^ 

n=—oo 

For  an  M  channel  multipoint  multirate  system  with  analysis  filters  {Ho{z),  Hi{z), 
•  •  •,  HMN-iiz)},  the  polyphase  representation  for  Hi{z)  is 

MN-l 

Hi(z)=  Yi 

k=0 

These  polyphase  components  can  be  arranged  into  a  matrix  E{z^^),  where  the 
row  of  E{z^^)  is  comprised  of  the  polyphase  components  of  Hi{z).  Thus,  the 
analysis  bank  can  be  represented  by  the  following  polyphase  matrix: 

Eo,mn-i{z^^) 

Em-1, 


E{z^^)  = 


Eo,o{z^^) 

Eo,i{z’^^) 

Eifliz^^) 

Ei,i(z^^) 

Em-1, o{z^^) 

Em-i,i{z’^^ 

This  matrix  can  be  passed  through  the  multipoint  decimators  by  applying  the 
first  multipoint  noble  identity  presented  in  section  3.1.8.  The  resulting  polyphase 
representation  of  the  multipoint  analysis  bank  is  shown  in  figure  14. 

Since  there  are  MN  polyphase  components  of  each  filter  Hi{z)  and  there  are 
M  analysis  filters  (an  M  channel  system),  the  polyphase  matrix  E{z)  is  M  x  MN. 
The  decimation  vector  length  N  generates  a  redundancy  in  this  representation  (in 
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Figure  14.  Multipoint  Polyphase  Representation 


a  conventional  M  channel  multirate  system,  the  polyphase  matrix  is  M  x  M).  This 
redundancy  will  cause  comb  filters  (reference  section  2.1)  to  arise  when  perfect  re¬ 
construction  multirate  filter  banks  are  designed. 

Recently,  Suter  and  Xia  [23]  presented  an  alternate  representation  of  the  mul¬ 
tipoint  polyphase  matrix.  They  called  this  representation  “vector  polyphase”.  In 
the  vector  polyphase  representation,  there  are  only  M  channels  in  the  resulting 
polyphase  system,  but  the  resulting  vector  polyphase  matrix,  E(z),  has  dimension 
MN  X  MN.  Thus,  the  redundancy  is  still  present  and  built  directly  into  the  vector 
polyphase  matrix. 

3.1.10  Conditions  for  Perfect  Reconstruction  in  Multipoint  Multirate  Sys¬ 
tems.  The  output  of  a  multipoint  multirate  system  is  typically  multiple  com¬ 
binations  of  the  polyphase  components  of  the  input  signal  x{n).  These  components 
are  scaled  and  shifted  in  such  a  way  that  the  original  signal  is  not,  in  general,  recov¬ 
erable  from  this  output.  This  is  due  to  the  fact  that  multipoint  decimators  create 
aliasing,  and  multipoint  building  blocks  are  time  varying  operators.  However,  it  is 
possible  to  control  the  analysis  and  synthesis  filters  which  make  up  the  multipoint 
multirate  system  such  that  the  output  X{z)  of  the  system  is  a  scaled  and  delayed 
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version  of  the  input  X{z)  to  the  system.  That  is,  X{z)  =  cz  '^°X{z)  for  some  scalar 
c  and  some  integer  mo-  When  this  is  true,  the  multipoint  multirate  system  exhibits 
the  perfect  reconstruction  property. 


3.1.10.1  Vector  Polyphase  Requirement  for  Perfect  Reconstruction. 
Given  the  vector  polyphase  representation  E(z)  of  an  analysis  bank  and  the  vector 
polyphase  representation  R(z)  of  a  synthesis  bank,  the  multipoint  multirate  system 
exhibits  perfect  reconstruction  if  and  only  if  [23] 


P{z)  =  R{z)E{z)  =cz-^<^ 


0  Im-t 
Z~^Ir  0 


®  In 


where  c  is  any  scalar,  tuq  is  a  nonnegative  integer,  r  G  {0, 1,  •  •  • ,  M  —  1},  and  (g)  de¬ 
notes  the  tensor  product.  If  the  vector  polyphase  representation  E(z)  of  a  multipoint 
analysis  bank  is  made  to  be  paraunitary,  and  R(z)  chosen  such  that  R(z)  =  E(z), 
then  the  multipoint  multirate  system  will  be  a  perfect  reconstruction  system  [23]. 
These  properties  can  all  be  tied  to  the  multipoint  polyphase  representation  developed 
in  section  3.1. 


3.1.11  Multipoint  Polyphase  Requirements  for  Perfect  Reconstruction.  Fig¬ 
ure  15  shows  the  polyphase  representation  of  a  multipoint  multirate  system  with 
decimation  ratio  M  and  vector  length  N.  Note  that  the  polyphase  representation 
has  MN  channels  due  to  the  redundancy  of  this  notation.  The  matrix  P{z^)  shown 
in  figure  15  is  the  multipoint  system  polyphase  matrix  P{z)  =  R{z)E{z),  where 
E{z)  and  R{z)  are  the  polyphase  representations  of  the  multipoint  analysis  bank 
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and  synthesis  bank,  respectively.  Thus, 


E{z^)  = 


R{z^)  = 


Eo,i{zn 

Eo,MN-i{z^) 

Ei,i{z^) 

Ei^mn-i{z^) 

Em-1, o{z^) 

Em-1, i{z^) 

Em-1, MN-l{z^) 

Ro,o{z^) 

Ro,l{z’^) 

■■■  Ro,m-i{z^) 

Ri,o{z^) 

Rh^iz’^) 

■■■  Ri,m-i{z^) 

RMN-\fl{z^)  RmN-1,\{z^) 


Rmn-i,m-A^^) 


P{Z^)  = 


Px,i{z^) 


Po,MN-i{z^) 

Pl,MN-l{z^) 


Pmn-\,q{z^)  Pmn-\,i{z^) 


X(z)^ 

Uo(z)  ^ 

M,N 

Vo(z) 

Wo(z)  [ 

M,N 

Yo(z)  ^ 

z" 

Udz)  ,[ 

M,N 

Vi(z)  . 

W,(z)J 

M,N 

Yi(z)  , 

z-' 

z" 

. 

P(z") 

z" 

z" 

} 

M,N 

W  (z) 

MN-l' 

|m,n 

|Y  (z) 

I  J 

z" 

X(z) 


Figure  15.  Multipoint  System  with  Polyphase  Matrix  P[z) 

In  order  to  find  the  conditions  required  for  perfect  reconstruction  in  the  multi¬ 
point  multirate  system  shown  in  figure  15,  it  is  necessary  to  find  the  transfer  function 
of  the  entire  system.  That  is,  given  an  input  signal  X(z),  what  is  the  output  X{z)? 
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The  expressions  for  the  output  of  multipoint  decimators  and  expander  derived  in 
section  3.1  make  this  analysis  possible. 

Given  the  input  signal  X{z)^  the  input  to  the  multipoint  decimator  in  each 
channel  of  the  polyphase  system  is  given  by  Uk{z)  =  X{z)z~^ ,  where  k  G  {0,  1, 
•  •  •,  MN  -  1}  is  the  number  of  the  channel.  The  output  of  each  decimator  is  Vk{z), 
where 


Vki^)  =  {Uk{z))  J.M,W 

MN-l 

=  z-‘El{z^^) 

1=0 

where  the  E'i(z)  are  the  MN  polyphase  components  of  Uk{z). 

Uk{z)  can  be  written  in  terms  of  the  polyphase  components  of  X{z)  as  follows: 

MN-l 

=  E  ^~‘Ei{z^^) 

1=0 

Ut{z)  =  X(z)z-'‘ 

MN-l 

=  .2-*=  ^~'Ei{z^^) 

1=0 

MN-l 

1=0 

Making  the  change  of  variables  7  =  /  +  A:,  we  find  that 


MN-l+k 

U,(z)  =  Y. 

‘y=k 

M7V-1  MN-l+k 

=  Y  z-zE,^t(z^'')+  Y  z-zE^+tiz^^) 

'y=k  ‘y=MN 

MN-l  k-1 

=  Y1  z-'^E^+kiz’^^)  +  E  z-'^-^^E^+MN-kiz^^) 

'y=k  'y=0 

MN-l  k-1 

=  Y  z-'E^+z{z'^'')  +  z-^”Yz~''E-,+mn-i,{z^”) 

7=fc  7=0 
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But  the  expression  for  Uk{z)  in  terms  of  its  own  polyphase  components  E'i{z)  is  given 

by 


MN-l 

1=0 

By  equating  this  expression  for  Uk{z)  and  the  previous  expression  for  Uk{z),  we  find 
that 

"  Ei-k{z^^)  iov  k<l<  MN  -  1 

^  z-^^Ei-k+MN{z^^)  for  0  <  /  <  -  1 

and  the  final  expression  for  Uk{z)  is 


El{z^^) 


k-l 

E 

1=0 


MN-l 

Uk{z)  =  Y^z-^^z-^Ei+MN-kiz’^^)+  E  z-^Ei_k{z^^) 

i=k 


The  output  of  the  decimator  in  channel  k  is  given  by 


Vk(z)  =  {Uk{z))  Im,n 

n=0 

where  the  Ek„{z)  are  the  MN  polyphase  components  (indexed  by  n)  of  the  signal 
Uk{z). 

However,  we  know  that 


Ek„{^)  = 


Z  Eji-^MN—k(^z'^ 
En—ki^Z^ 


for  0  <  n  <  ^  —  1 
for  k  <  n  <  MN  —  1 


and  k  is  limited  to  the  range  0  <  A:  <  TV  —  1.  Therefore,  the  expression  for  the 
output  of  the  decimator  in  each  channel  is  given  by 


Vk{z)  =  E  Z-^En+MN-k{z^)z-^  +  E  En-k{z^)z-- 

n=0  n=k 
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Now,  the  polyphase  system  matrix  P(z^)  is  applied  to  the  output  of  the  deci- 
mators.  In  each  channel,  this  is  accomplished  by  taking  the  inner  product  of  the 
row  of  P{z^)  with  the  column  vector  whose  entries  are  the  outputs  of  the  decimators. 
This  result  is  given  by 

l-l  /MN-l 

Wk{z)  =  E  M^'')En+MN-l{z^) 

n=0  \  /=0 

N-1  /MN-l 

n=/  \  i=rO 

AT-l  /MN-l 

=  E^“"  E  Pu{^")e{n,i,z^) 

n—0  \  l—O 


where 


£{n,  /,  z) 


En-i(z)  l<n<N-l 

Z~^Bn+MN-t(z)  0  <  n  <  I  -  1 


By  close  observation  of  this  expression  for  Wk{z),  we  find  that  the  expression 
inside  the  large  parentheses  is  completely  composed  of  powers  of  z^ .  Thus,  the 
polyphase  component  of  Wk{z)  is  given  by 


MN-l 

Pki{z^)£{n,l,z^) 


1=0 


The  output  of  the  multipoint  expander  is  given  by 
Y,(z)  =  (W,{z))  ]m.n  =  E 

m=0 

where  Fk^{z)  are  the  0  <  m  <  Al  —  1  polyphase  components  of  Wk{z). 

Therefore,  the  complete  expression  for  the  output  of  each  expander  is 
N-l  /MN-l 

Ykiz)  =J2z-^[  Pki{z^^mmJ,z^^) 

m=0  \  1=0 
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and,  multiplying  each  Yk{z)  by  and  summing  over  k,  the  expression  for 

the  output  of  the  multipoint  multirate  system  is  given  by 

MN-l  /N-1  /MN-1 

Xiz)^  E  z-^  I  E 

k—O  Vto=0  \  l—O 

where 

Em-i{z)  I  <m  <  N  -  \ 

Z-^ Era+MN-l{z)  0  <  m  <  /  -  1 

are  the  NM  polyphase  components  of  the  original  input  signal  X{z). 

Now  that  we  have  an  expression  for  the  output  of  the  multipoint  polyphase 
system,  it  can  be  analyzed  to  find  the  conditions  needed  for  perfect  reconstruction. 
The  polyphase  components  of  X(z)  are  all  present  in  the  above  equation,  but  they  are 
weighted  by  various  entries  of  P{z)  and  summed  three  different  times.  In  order  for 
the  system  to  exhibit  perfect  reconstruction,  the  output  must  include  each  polyphase 
component  of  X{z),  and  they  must  be  weighted  by  cz~'^°'^’^,  where  c  is  a  scaler,  mo 
is  an  integer,  and  k  is  the  number  of  the  polyphase  component.  If  P  =  7,  then  this 
condition  will  hold. 

Unfortunately,  it  is  not  possible  for  P  to  equal  the  identity.  P  is  the  product 
of  the  MN  X  M  matrix  R  and  the  M  x  MN  matrix  E.  Therefore,  the  rank  of  P 
can  be  no  greater  than  M,  and  P  cannot  be  row-equivalent  to  the  identity  matrix. 
However,  P  does  not  have  to  equal  the  identity. 

Define  the  matrix  to  be  the  singular  matrix  of  zeros  with  the  single  entry 
at  position  i,j  equal  to  one.  Let  P{z)  =  Im  ®  ^Noo-  Thus,  P{z)  is  a  matrix  of  zeros, 
with  M  equally  spaced  values  of  one  on  the  main  diagonal.  A  multipoint  multirate 
system  with  such  a  P{z)  will  exhibit  the  perfect  reconstruction  property.  The  proof 
is  given  below. 

Let  Xa{z)  be  a  polyphase  component  of  the  system  output  X{z).  To  select  this 
component  out  of  the  expression  for  X{z),  the  values  of  m  and  k  must  be  selected 


£{m,  /,  z) 
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such  that  £{m,k,z)  is  a  function  of  only  Eo,{z).  Also,  we  know  that  =  1  if 
i  =  j  and  i  is  a  multiple  of  N,  and  Pij  =  0  otherwise.  With  this  information,  the 
expression  for  Xa{z)  becomes 

MN-l—a 

Xa{z)  =  {z-^‘^+'^^Pkk{z^^)Ec,{z^^))  •  •  • 

k—0 
MN-1 

k=MN-a 

This  equation  reduces  to 


Xa.(z)  = 


Thus,  when  P{z)  =  Im  ®  ^Noo?  ^^^h  of  the  MN  polyphase  component  of  the 
input  X(z)  appears  at  the  output,  they  are  appropriately  expanded  and  delayed, 
and  the  system  satisfies  the  perfect  reconstruction  property. 

In  general,  sufficient  conditions  for  perfect  reconstruction  in  the  multipoint 
multirate  system  are 


P{z)  =  cz-'^^ 


0  Im-t 
Z~^Ir  0 


where  c  is  any  scalar,  mo  is  an  integer,  and  0  <  r  <  M  —  1.  For  a  proof  of  these 
general  conditions,  see  Appendix  B. 

If  the  polyphase  matrices  E{z)  and  R{z)  are  chosen  such  that  R{z)  =  E{z), 
then  the  perfect  reconstruction  requirement  demands  that  the  columns  of  E{z)  be 
orthogonal.  However,  since  the  rank  of  E{z)  is  at  most  M,  only  M  of  the  columns 
can  be  linearly  independent.  Thus,  E{z)  must  be  chosen  such  that  only  M  of  its 
columns  are  non-zero.  Of  course,  these  M  non-zero  columns  must  be  orthogonal  to 
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each  other.  When  E{z)  and  R{z)  are  chosen  in  this  manner,  the  resulting  P{z)  is 
sufficient  for  perfect  reconstruction. 

This  requirement  on  E{z)  can  be  related  back  to  the  polyphase  components  of 
the  original  filter  bank.  Recall  that 


Eo,o{z:) 

^0,1  (^)  •• 

Eo,mn-i{z) 

E{z)  = 

Eifiiz) 

Ei,mn-i{z) 

1 

1 

O 

Em-i,i{^)  '  ■ 

■  Em-1, 

The  row  of  E{z)  is  composed  of  the  MN  polyphase  components  of  the  analysis 
filter  Hk{z).  However,  if  E{z)  satisfies  the  perfect  reconstruction  condition,  then  only 
M  of  these  MN  entries  are  non-zero.  That  is,  the  filter  Hk{z)  only  has  polyphase 
components  Ek,i{z)  where  I  is  a  multiple  of  M.  Thus, 

MN-l 

Hk{z)  =  ^  Ei{z^^)z-‘ 

1=0 

M-l 

=  EnN{z^^)z-^^ 

n=0 

because  the  polyphase  components  Ei{z)  are  zero  for  I  not  a  multiple  of  N. 

If  we  let  some  prototype  filter  H'j^{z)  be  defined  by 

M-l 

n=0 

it  becomes  clear  that  Hk{z)  =  {HI{z))'\n.  That  is,  Hk{z)  is  created  from  the  proto¬ 
type  filter  H'^{z)  by  conventional  expansion  by  N .  Hk{z)  is  a  comb  filter  (reference 
section  2.1). 

This  analysis  demonstrates  how  comb  filters  naturally  arise  in  multipoint  mul¬ 
tirate  systems.  If  the  sufficient  conditions  for  perfect  reconstruction  are  to  hold,  the 
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filters  which  make  up  the  analysis  and  synthesis  banks  must  be  comb  filters  created 
from  some  set  of  prototype  filters.  Also,  these  prototype  filter  must  form  a  con¬ 
ventional  paraunitary  set  to  ensure  that  the  columns  of  the  multipoint  polyphase 
matrix  E{z)  are  orthogonal.  This  provides  a  quick  method  for  generating  perfect  re¬ 
construction  multipoint  systems  for  various  vector  lengths  from  a  set  of  conventional 
perfect  reconstruction  filters. 

3.1.12  Design  of  Perfect  Reconstruction  Filter  Banks  using  the  Vector  Polyphase 
Notation.  The  design  of  perfect  reconstruction  filter  banks  can  also  be  accom¬ 
plished  from  an  analysis  of  the  vector  polyphase  notation  [23].  The  same  results  will 
be  found  to  hold:  the  resulting  filters  for  vector  length  N  are  comb  filters  generated 
by  conventional  expansion  by  N. 

Given  the  properties  of  perfect  reconstruction  (PR)  multipoint  multirate  sys¬ 
tems  presented  in  section  3.1.10,  the  goal  is  to  design  an  analysis  filter  bank  and  a 
synthesis  filter  bank  such  that  the  multirate  system  satisfies  the  PR  property.  This 
can  be  accomplished  by  choosing  the  analysis  filters  such  that  the  vector  polyphase 
matrix  E(z)  is  paraunitary,  then  choosing  the  synthesis  filters  such  that  R(z)  =  E(z) 
[23].  The  problem  lies  in  designing  an  analysis  bank  such  that  the  resulting  vector 
polyphase  matrix  E(z)  is  paraunitary. 

Let  Tn  be  a  linear  transformation.  Given  a  set  of  prototype  filters  {Hq{z), 
H[{z),  •••,  Hj^_i{z)}  which  satisfy  the  PR  property  in  a  conventional  multirate 
system,  does  there  exist  a  set  of  filters  {Tm[Hq{z)],  Tn[H[{z)],  ■■■,  Tn[Hm_i{z)]} 
which  satisfy  the  PR  property  for  a  multipoint  multirate  system  with  vector  length 

m 

In  the  traditional  multiresolution  wavelet  decomposition,  decimation  by  two  is 
performed  at  each  stage.  The  vector  representation  of  a  filter  H{z)  with  decimation 
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ratio  M  =  2  and  vector  length  N  is  given  by  Xia  and  Suter  [23]  to  be 


ffoW 

2:  ^Hn^i{z) 

Z  ^Hn-2{z) 

■■  z  ^Hi{z) 

Hi(^) 

Ho{z) 

z-^Hn-i{z)  ■■ 

Z-^H2{z) 

H(z)  = 

H2{z) 

Hi{z) 

Ho{z) 

■■  z-^Hs{z) 

1 

h-l 

Hn-2{z) 

Hn-3{z)  ■  ' 

Ho{z) 

In  general,  bold  face  denotes  the  vector  representation  of  a  filter,  and  normal  font 
denotes  the  scalar  form  of  a  filter. 

A  close  analysis  of  the  derivation  of  this  matrix  yields  that  the  entries  of  H(z) 
are  actually  the  N  conventional  polyphase  components  of  the  filter  H{z).  That  is,  if 

H{z)  =  Ek{z^)z->^ 

k=0 

then  the  vector  matrix  representation  of  H{z)  is 


z  ^En-.i{z) 

Z  ^En-2{z)  •' 

z-^E,{z) 

Ei(2) 

Eo{z) 

7 

1 

■■  Z~^E2{z) 

H(z)  = 

E2{z) 

Ei{z) 

Eo{z) 

■■  z-^E^{z) 

EN-liz) 

Hn-2{^) 

TT 

•  1 

■  •  Eo{z) 

Each  of  the  entries  of  H(z)  can  be  broken  into  its  two  conventional  polyphase 
components.  That  is,  we  can  replace  each  Ei{z)  with  its  polyphase  representation 


Ei{z)^Ei,o{z^)  +  z-^Ei,,{z^) 


After  substituting  these  polyphase  components  for  every  entry  of  H(z),  then 
H(z)  can  then  be  split  into  two  submatrices.  The  first  is  composed  entirely  of  even 
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powers  of  and  the  second  composed  of  odd  powers  of  This  expression  for  H(z) 
is; 

H(z)  =Ee(z")  +  ^"'Eo(z") 

where 

E,,„{z^)  E„4z^)  ■■■  z-^E,z(z^) 

Ejv-2,o(-2^)  •••  Eofli^^) 

and 

Eo,i(^2)  EAr-i,o(;^')  •••  E,,o{z^) 

EoAz^)  •••  E2,o{z^) 

En-iA^^)  En-2A^^)  •••  EoA^") 

These  matrices  Ee(z^)  and  Eo(z^)  are  the  vector  polyphase  components  of 
the  matrix  H(z).  The  elements  of  these  vector  polyphase  matrices  are  actually  the 
2N  conventional  polyphase  components  of  the  filter  H{z). 

The  goal  of  this  analysis  is  to  relate  the  elements  of  the  vector  polyphase 
matrices  to  the  polyphase  components  of  a  base  filter,  H'{z).  Assume  that  the  base 
filter  H'{z)  is  part  of  a  perfect  reconstruction  set  for  a  conventional  multirate  filter 
bank  with  decimation  ratio  M  =  2.  Assume  that  the  filter  H{z)  (from  which  the 
vector  polyphase  matrices  above  were  derived)  is  part  of  the  analysis  bank  for  a 
multipoint  multirate  system  with  decimation  ratio  M  —  2  and  vector  length  N. 

Now,  assume  that  H{z)  =  Tjv  {H'{z)}^  where  the  linear  transformation,  T^,  is 
conventional  expansion  by  N.  The  resulting  filter  H{z)  =  {H'{z))  Iat  =  H'[z^)  is  a 
“comb  filter”  [5] 
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The  conventional  polyphase  representation  of  H'{z)  with  M  =  2  is 


Thus,  the  filter  H{z)  can  be  written  in  terms  of  the  conventional  polyphase  compo¬ 
nents  of  H'{z)  as  follows: 

H{z)  =  H\z^) 

=  E'^{z^^)  +  z-^E'o{z^^) 

However,  representing  H(z)  in  terms  of  its  own  N  conventional  polyphase  compo¬ 
nents  yields 

H{z)  =  i:  Et{z'‘)z-'’ 

=  £0(2")  +  +  ■  ■  ■  + 

By  equating  terms  in  this  expression  for  H{z)  and  the  previous  expression  for  H[z), 
we  find  that  the  conventional  polyphase  components  are  related  by 

£„(z'')  =  +  z-^E'o(z-‘^) 

and 
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The  vector  representation  H(z)  of  the  filter  H{z)  can  now  be  written  in  terms 
of  the  conventional  polyphase  components  of  the  prototype  filter  H\z)  as  follows: 


E'g{z'^)+z-'E'o(z-‘)  0 

HW  = 

0  E'e^z-^)  +  z-^E'o(z^) 

By  splitting  this  matrix  into  its  even  and  odd  vector  polyphase  matrices  Ee(z) 
and  Eo(z),  an  expression  for  H(z)  can  be  derived  in  terms  of  the  conventional 
polyphase  components  of  the  prototype  filter  H'{z). 

H(z)  =  EeCz"*)  +  ^-'Eo(z") 

where 

E'e{z^)  0 

Ee(z^)  = 

0  E'e{z^) 

and 

E'oiz^)  0 

Eo(z^)  = 

0  E'oiz^) 

The  elements  in  these  two  vector  polyphase  matrices  are  the  convention  polyphase 
components  of  the  prototype  filter  H'{z). 

The  same  analysis  can  be  used  to  derive  the  vector  polyphase  representation 
of  a  second  filter  G{z).  That  is,  it  is  assumed  that  G{z)  =  G'{z^),  that  G'{z)  is  part 
of  a  conventional  perfect  reconstruction  multirate  system,  and  that  the  conventional 
polyphase  representation  of  G'{z)  with  Af  =  2  is  given  by 

a{z)  =  F^{z^)  +  z-^F^{z^) 
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With  these  assumptions,  the  vector  polyphase  matrix  E(z)  for  the  complete  two 
channel  multipoint  multirate  system  with  decimation  ratio  M  =  2  and  vector  length 
N  is  given  by 


Ee(z)  Eo(z) 

Fe(z)  Fo(z) 

E>e{z)  0  E'oiz)  0 


0  E'M  0  E'oiz) 

E'e{z)  0  E'oiz)  0 


0  F'^iz)  0  E^,iz) 


If  the  conventional  polyphase  matrix  Eiz)  of  the  set  of  filters  H'iz)  and  G'iz)  is 
paraunitary,  then  the  vector  polyphase  matrix  E(z)  formed  from  Hiz)  and  Giz)  will 
also  be  paraunitary,  and  the  resulting  multipoint  multirate  system  with  decimation 
ratio  M  =  2  and  vector  length  N  will  exhibit  perfect  reconstruction. 

This  result  reiterates  the  result  of  section  3.1.11,  in  that  a  multipoint  perfect 
reconstruction  set  can  be  constructed  from  comb  filters.  This  provides  a  simple 
and  quick  algorithm  for  generating  perfect  reconstruction  multipoint  multirate  filter 
banks.  Given  a  set  of  conventional  perfect  reconstruction  filters  (which  are  readily 
available  in  the  literature  [17,  19,  2,  22]),  a  new  set  of  perfect  reconstruction  filters 
can  be  easily  formed  for  a  multipoint  multirate  system  for  any  vector  decimation 
length.  Thus,  the  wavelet  decomposition  can  be  generalized  to  include  varying  vector 
lengths  at  each  level.  With  the  above  methods  for  generating  perfect  reconstruction 
filter  banks,  only  one  set  of  prototype  filters  is  necessary.  The  multipoint  filters 
for  each  vector  length  are  generated  as  comb  filters  from  the  prototype  filters,  and 
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the  resulting  generalized  wavelet  decomposition  satisfies  the  perfect  reconstruction 
property. 

3.2  Wavelet  Decomposition  with  Multipoint  Multirate  Systems 

The  traditional  binary  tree  structured  wavelet  decomposition  using  a  multirate 
filter  bank  was  shown  in  figure  16  and  discussed  in  section  2.4.2.  The  filters  H{z)  and 
G(z)  which  make  up  the  analysis  bank  are  typically  a  low  pass  filter  and  high  pass 
filter  respectively,  and  together  they  form  a  perfect  reconstruction  set  (paraunitary 
pair). 

By  applying  the  algorithm  developed  in  section  3.1.12,  a  new  perfect  recon¬ 
struction  pair  Hn^{z)  and  Gni^{z)  can  be  generated  for  any  vector  length  Nk  from 
the  original  filters  H(z)  and  G(z).  Thus,  the  conventional  decimators  and  expanders 
in  the  wavelet  tree  can  be  replaced  with  multipoint  decimators  and  expanders.  If  the 
filters  at  each  level  of  the  tree  are  replaced  with  the  appropriately  chosen  and 

GNki^)^  the  entire  system  will  still  exhibit  the  perfect  reconstruction  property. 
The  resulting  multipoint  wavelet  decomposition  tree  with  generic  vector  lengths  is 
shown  in  Figure  16. 


X(z) 

Figure  16. 


Multipoint  Wavelet  Decomposition  Tree  with  Generic  Decimation  Vec¬ 
tor  Lengths 
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The  advantage  of  such  a  system  is  that  the  decimation  vector  length  can  be 
varied  at  each  level,  thus  redistributing  the  energy  of  the  original  signal  throughout 
the  decomposition  tree.  The  choice  of  vector  lengths  may  be  made  such  that  the 
energy  distribution  of  the  decomposed  signal  is  optimal  in  some  sense.  Thus,  by  pro¬ 
cessing  a  signal  with  new  decomposition  algorithm,  a  higher  rate  of  data  compression 
may  be  achieved. 
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IV.  A  Data  Compression  Feasibility  Study 

4.1  Introduction 

The  goal  is  to  achieve  superior  data  compression  over  the  traditional  mul¬ 
tiresolution  wavelet  decomposition  by  employing  multipoint  multirate  in  the  binary 
decomposition  tree.  This  approach  will  permit  the  decimation  vector  length  N  to 
be  varied  at  each  level  of  the  decomposition.  Section  4.2  will  explore  methods  of 
increasing  the  data  compression  by  redistributing  the  energy  in  the  high  frequency 
subbands  [15]. 

4.2  Energy  Redistribution  Between  Levels  of  the  Multiresolution  Analysis. 

At  each  level  of  the  wavelet  decomposition,  the  coefficients  are  decimated  by 
a  factor  of  two.  However,  only  the  coarse  coefficients  are  further  decomposed.  If 
the  energy  of  the  signal  happens  to  be  concentrated  at  a  coarse  decomposition  level, 
fewer  coefficients/bits  will  be  needed  to  represent  that  signal  than  if  the  signal  energy 
is  concentrated  at  the  more  detailed  levels  which  underwent  less  decimation.  Thus, 
improved  data  compression  should  be  achievable  if  the  energy  of  the  signal  can  be 
forced  down  to  the  coarser  decomposition  levels. 

Figures  17  and  18  show  a  paraunitary  prototype  filter  set  and  the  related  comb 
filters  which  can  be  used  in  a  multipoint  multirate  perfect  reconstruction  system.  The 
Daubechies  filter  Ds  was  chosen  as  the  prototype  because  it  has  compact  support 
and  a  relatively  narrow  transition  band.  This  “sharpness”  of  the  filter  allows  for 
a  decomposition  based  on  the  spectral  content  of  a  signal,  without  the  increased 
processing  time  of  a  larger  filter. 

Each  of  the  filters  shown  in  figures  17  and  18  can  be  part  of  a  perfect  recon¬ 
struction  set  if  the  decimation  vector  lengths  are  chosen  appropriately. 
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2 


Figure  17. 


2  I - 1 - 1 - 1 - r 


2  I - 1 - 1 - 1 - 1 - 1 - — - r 


2  I - 1 - 1 - 1 - 1 - 1  r 


Daubechies  Low  Pass  Filter  H{z)  for  Various  Vector  Lengths,  (a)  Pro¬ 
totype  Filter,  (b)  Vector  Length  of  2.  (c)  Vector  Length  of  4.  (d)  Vector 
Length  of  8 


At  each  stage  of  the  decomposition,  the  signal  is  divided  into  a  low  frequency 
and  high  frequency  subband  via  application  of  H  and  G,  respectively.  The  low 
frequency  band  is  then  decomposed  again,  as  shown  in  figure  16.  In  the  traditional 
multiresolution  wavelet  decomposition,  only  conventional  multirate  building  blocks 
are  used,  so  the  only  choice  of  filters  are  the  standard  low  pass  H  and  high  pass 
G  (shown  in  figures  17a  and  18a).  However,  when  the  wavelet  decomposition  is 
generalized  to  allow  multipoint  decimation  with  varying  vector  lengths  at  each  level 
of  the  decomposition  (as  shown  in  figure  16),  any  of  the  filters  from  figure  17  can 
be  used.  The  choice  of  decimation  vector  length  N  (or  ,  equivalently,  the  choice  of 
expansion  ratio  applied  to  the  prototype  filters  H  and  G)  can  be  made  at  each  level 
to  maximize  the  amount  of  signal  energy  passed  into  the  low  frequency  subband. 
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Figure  18.  High  Pass  Filter  for  Various  Vector  Lengths,  (a)  Prototype  Filter. 

(b)  Vector  Length  of  2.  (c)  Vector  Length  of  4.  (d)  Vector  Length  of  8 

If  the  signal  is  a  low  pass  signal,  then  the  optimum  choice  of  vector  length  will 
always  be  iV  =  1.  This  is  shown  by  figure  18a,  where  the  filter  with  the  least  low 
frequency  content  is  the  prototype  filter.  Any  choice  of  V  >  1  will  shift  sections  of 
the  pass  band  of  G  toward  the  low  frequencies  and  possibly  increase  the  amount  of 
signal  energy  passed  through  G.  Since  the  goal  is  to  maximize  the  amount  of  energy 
passed  through  H  (and  therefore  minimize  the  amount  of  energy  passed  through  G), 
choosing  N  >  1  can  only  adversely  effect  the  energy  distribution.  Thus,  in  terms 
of  energy  redistribution,  if  the  data  signal  is  low  pass,  a  multipoint  multirate  filter 
bank  cannot  improve  data  compression. 

However,  if  the  signal  is  band  pass  or  high  pass,  a  choice  of  decimation  vector 
length  V  /  1  can  significantly  impact  the  distribution  of  the  signal  energy  between 
subbands.  For  example,  reference  the  signal  and  its  spectrum  displayed  in  figure 
19.  This  signal  is  colored  noise  ranging  in  normalized  digital  frequency  from  0.1  to 


51 


0.4  (where  1.0  corresponds  to  the  Nyquist  rate).  If  the  vector  decimation  length 
is  =  1,  a  significant  portion  of  the  energy  will  be  passed  into  the  first  high 
frequency  decomposition  level,  “c?l”.  This  is  because  half  of  the  signal  energy  exists 
at  frequencies  higher  than  the  0.25  cutoff  of  G{z)  (reference  figure  18-a).  For  other 
choices  of  vector  length  (iV  =  4  or  fV  =  8),  less  spectral  energy  of  the  signal  overlaps 
with  the  expanded  high  pass  decomposition  filter  G{z^)  (reference  figure  18c, 18d). 


Figure  19.  (a)  Band  Pass  Signal,  (b)  Spectrum  of  Signal 

At  each  level  of  the  decomposition,  a  new  vector  length  can  be  chosen  which 
maximizes  the  energy  pushed  into  the  low  pass  subband.  Figure  20  shows  the  dis¬ 
tribution  of  energy  for  optimal  choices  of  decimation  vector  length  N  compared  to 
the  traditional  choice  of  A"  =  1  at  each  level. 

The  abscissa  in  figure  20  represents  the  high  frequency  fraction  of  the  spectrum 
at  each  level  of  the  decomposition.  That  is,  the  first  half  of  the  signal  spectrum  is 
represented  by  the  detail  coefficients  dl,  while  the  second  half  of  the  signal  spectrum 
is  further  composed  into  62  and  c2.  Thus,  in  figure  20  ,  “0.5”  corresponds  to  dl, 
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“0.75”  corresponds  to  d\  +  d2,  “0.875”  corresponds  to  dl  +  d2  +  d3,  etc.  The  value 
of  “1”  is  the  entire  spectrum:  all  the  detail  coefficients  d\  to  di,  as  well  as  the  last 
coarse  coefficients  c^. 

The  ordinate  in  figure  20  represents  the  fraction  of  signal  energy  present  in  the 
spectral  bands.  This  value  begins  with  the  fraction  of  energy  present  in  the  detail 
coefficients  dl,  and  increases  to  “1”  as  the  fraction  of  the  spectrum  increases  to  “1”. 

For  the  signal  shown  in  figure  19,  the  optimal  choice  of  N  was  N  =  [8, 1, 4, 8, 8]. 
That  is,  the  choice  of  vector  length  N  =  S  minimized  the  amount  of  energy  passed 
into  the  first  detail  coefficients  dl  (or,  conversely,  maximized  the  amount  of  energy 
passed  into  the  first  coarse  coefficients  cl).  At  the  second  level,  the  choice  of  =  1 
minimized  the  energy  passed  from  cl  into  d2.  At  the  next  levels,  A^  =  4  was  the  best 
choice  to  minimize  the  energy  in  d3,  and  N  =  8  was  the  best  choice  to  minimize  the 
energy  in  both  d4  and  d5  (only  five  levels  of  decomposition  were  performed). 

Figures  21  to  35  show  other  test  signals  and  the  results  of  the  energy  redistri¬ 
bution.  In  figure  21,  the  signal  is  a  narrow  band  signal  which  ranges  in  normalized 
digital  frequency  from  0.22  to  0.28.  Figure  22  shows  the  results  of  the  energy  redis¬ 
tribution  for  the  choice  A’  =  [4, 4, 1, 8, 8].  For  this  signal,  the  redistribution  of  energy 
to  the  lower  bands  is  much  better  than  that  for  the  signal  shown  in  figure  19.  This 
is  because  the  narrow  band  signal  “fits”  better  into  the  nulls  of  the  expanded  comb 
filters  G{z^). 

This  idea  of  narrow  band  signals  fitting  into  the  stop  bands  of  the  expanded 
filters  is  best  demonstrated  with  a  pure  sinusoid  (which  ideally  has  all  of  its  energy 
concentrated  into  one  spectral  line).  Figure  23  shows  a  sinusoid  and  its  spectrum,  and 
figure  24  shows  the  results  of  energy  redistribution.  In  this  case,  the  optimal  choice 
of  vector  lengths  was  A  =  [1, 1, 8, 8, 8].  With  the  conventional  wavelet  decomposition 
(A  =  1  at  each  level),  the  energy  of  the  signal  is  distributed  to  the  subband  where 
its  frequency  “naturally”  falls.  With  optimal  vector  choices,  the  energy  is  entirely 
distributed  to  the  coarsest  decomposition  level.  This  result  will  hold  true  for  any 
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(a)  (b) 

Figure  21.  (a)  Narrow  Band  Pass  Signal,  (b)  Spectrum  of  Signal 

sinusoid  or  extremely  narrow  band  signal.  Since  a  comb  filter  emphasizes  certain 
periodicities  in  a  signal  (see  section  2.1),  it  is  possible  to  match  a  comb  filter  to 
the  frequency  of  the  sinusoidal  input  signal.  Thus,  if  the  decimation  vector  lengths 
N  are  chosen  to  match  the  frequency  of  the  input  signal,  then  the  signal  will  be 
passed  through  the  series  of  coarse  decomposition  comb  filters  to  the  lowest  level  of 
decomposition. 

Figures  25  to  28  demonstrate  the  results  of  the  energy  redistribution  algorithm 
on  a  low  frequency  band  pass  signal  and  a  high  pass  signal.  Note  that  the  low 
frequency  band  pass  signal  is  not  low  pass,  but  rather  a  band  pass  signal  in  the 
lower  part  of  the  spectral  band.  As  expected,  the  results  of  energy  redistribution  on 
the  low  frequency  band  pass  signal  are  minimal,  because  this  signal  is  closely  matched 
to  the  prototype  low  pass  filter  H{z).  However,  with  the  high  pass  signal,  the  energy 
improvements  are  dramatic.  Because  the  high  pass  signal  is  closely  matched  to  the 
prototype  high  pass  filter  G(z),  any  choice  of  vector  length  N  ^  1  (which  expands 


55 


Fraction  of  Spectrum 


Figure  22.  Energy  Distribution  for  a  Narrow  Band  Signal.  Solid  line  is  choice  of 
iV  =  1  at  each  level.  Dotted  line  is  optimal  choice  of  =  [4,4, 1,8,8] 
at  each  level 


G{z)  and  shifts  portions  of  its  pass  band  to  lower  frequencies)  significantly  reduces 
the  energy  passed  to  the  detailed  subbands. 


(a)  (b) 

Figure  25.  (a)  Low  Frequency  Band  Pass  Signal,  (b)  Spectrum  of  Signal. 

Figure  29  is  an  edge  enhanced  version  of  the  common  test  image  “Lenna”. 
This  edge  enhancement  was  performed  by  applying  a  high  pass  filter  to  the  original 
image.  Since  edge  enhancement  is  a  common  technique  in  digital  image  processing, 
this  is  a  reasonable  signal  to  process  with  the  energy  redistribution  algorithm.  To 
illustrate  this  energy  redistribution  process,  consider  “Lenna’s  eye”  as  depicted  in 
figure  30.  For  the  purpose  of  this  analysis,  this  64  x  64  image  is  treated  as  a  vector 
with  length  4096.  Figure  31  shows  the  spectrum  of  this  signal.  Although  it  is  a 
relatively  low  frequency  signal,  it  is  still  band  pass.  Therefore,  one  would  expect 
that  the  energy  redistribution  algorithm  would  have  a  positive  impact.  The  results 
of  this  redistribution  are  illustrated  in  figure  32,  where  an  improvement  is  noted. 

As  an  example  of  the  processing  of  zero  mean  images,  “Lenna’s  eye”  is  con¬ 
sidered  with  the  mean  subtracted  out  prior  to  processing.  Since  zero  mean  signals 
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Fraction  of  Spectrum 

Figure  26.  Energy  Distribution  for  a  Low  Frequency  Band  Pass  Signal.  Solid  line 
is  choice  iV  =  1  at  each  level.  Dotted  line  is  optimal  choice  of  iV  = 
[1,8, 8, 8, 2] 


have  no  energy  at  the  lowest  frequency  (DC),  the  corresponding  energy  distribution 
improvements  can  be  more  significant,  as  illustrated  in  figure  33. 


Figure  29.  Lenna 

Now  consider  the  signal  which  is  depicted  in  figure  34.  This  signal  is  band  pass 
with  localized  narrow  pass  features.  This  signal  and  its  spectrum  are  shown  in  figure 
34.  Although  the  signal  is  band  pass,  a  significant  portion  of  its  energy  is  in  the 
lower  part  of  the  spectrum.  This  implies  that  energy  redistribution  improvements 
will  be  minimal. 

The  results  of  the  energy  redistribution  are  shown  in  figure  35.  There  is  an 
improvement  in  the  distribution  of  the  energy,  but  it  is  slight.  Also,  at  the  fourth  level 
of  decomposition,  the  redistributed  energy  is  actually  higher  than  the  conventional 
decomposition.  It  is  possible  that,  by  distributing  slightly  more  energy  into  the 
higher  detail  coefficients,  the  overall  energy  distribution  could  have  been  even  further 
improved. 
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Fraction  of  Spectrum 


Figure  32.  Energy  Distribution  for  Lenna’s  Eye.  Solid  line  is  choice  of  =  1  at 
each  level.  Dotted  line  is  optimal  choice  of  iV  =  [1, 32, 1, 16, 16, 16, 1, 8] 
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Fraction  of  Spectrum 


Figure  33.  Energy  Distribution  for  Lenna’s  Eye  with  Zero  Mean.  Solid  line  is 
choice  of  iV  =  1  at  each  level.  Dotted  line  is  optimal  choice  of 
N  =  [1,32,1,16,16,16,1,8] 


Signal  Spectrum 


Figure  34.  (a)  Bandpass  Signal  with  Narrowband  Features,  (b)  Spectrum  of  Signal 
4.S  Summary 

Section  4.2  demonstrated  the  application  of  the  multipoint  wavelet  decompo¬ 
sition  algorithm  to  various  signals.  It  was  shown  that,  for  band  pass  or  high  pass 
signals,  the  spectral  energy  of  a  signal  can  be  redistributed,  forcing  more  of  the 
energy  down  to  the  coarse  coefficients.  Therefore,  for  this  class  of  signals,  the  mul¬ 
tipoint  wavelet  decomposition  algorithm  could  be  implemented  as  a  front  end  to  a 
vector  quantizer,  and  thus  used  to  prepare  a  signal  for  data  compression. 
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Figure  35.  Energy  Distribution  for  Bandpass  Signal  with  Narrowpass  Features. 

Solid  line  is  choice  iV  =  1  at  each  level.  Dotted  line  is  optimal  choice  of 
iV  =  [1,4,16,8,2] 


V.  Conclusions  and  Recommendations  for  Further  Study 

5.1  Conclusions 

This  thesis  provided  a  fundamentally  new,  systematic  study  of  multipoint  mul¬ 
tirate  signal  processing  systems.  This  study  was  accomplished  by  relating  multipoint 
multirate  systems  to  conventional  multirate  systems.  The  z-transforms  of  the  multi¬ 
point  decimator  and  multipoint  expander  were  derived  via  equivalent  circuits  com¬ 
prised  entirely  of  conventional  multirate  operators.  Proofs  were  presented  for  the 
basic  interconnections  of  the  multipoint  operators  and  for  the  multirate  noble  iden¬ 
tities.  The  multipoint  polyphase  representation  was  developed,  and  the  conditions 
sufficient  for  perfect  reconstruction  in  a  multipoint  multirate  system  were  presented. 

The  problem  of  perfect  reconstruction  multirate  filter  bank  design  was  ad¬ 
dressed.  The  natural  relationship  of  perfect  reconstruction  multipoint  multirate 
systems  to  comb  filters  was  shown.  In  addition,  the  concept  of  varying  the  vector 
lengths  at  each  level  of  a  generalized  wavelet  decomposition  had  never  been  explored 
prior  to  this  thesis. 

Once  these  theoretical  foundations  were  established,  they  were  then  applied 
to  a  data  compression  feasibility  study.  It  was  clearly  shown  that,  for  band  pass 
and  high  pass  signals,  energy  can  be  redistributed  in  the  corresponding  multipoint 
multirate  implementation  of  the  wavelet  decomposition.  This  distribution  may  prove 
useful  as  a  front  end  to  a  vector  quantizer. 

5.2  Recommendations 

The  following  recommendations  are  made  for  future  research: 

1.  With  the  encouraging  results  of  the  data  compression  feasibility  study,  a  vector 
quantizer  should  be  developed  that  utilizes  the  multipoint  multirate  wavelet 
decomposition  scheme  as  a  front  end. 
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2.  Conditions  for  multirate  perfect  reconstruction  may  be  equivalent  to  biorthog¬ 
onality  in  the  multipoint  wavelet  decomposition.  This  relationship  should  be 
explored. 

3.  The  optimal  choice  of  vector  length  at  each  stage  of  the  multipoint  wavelet 
decomposition  was  based  on  the  energy  distribution  of  the  following  decompo¬ 
sition  level.  A  “look  ahead”  algorithm  should  be  developed  which  chooses  the 
decomposition  vector  lengths  based  on  the  overall  energy  distribution  of  the 
decomposition. 

4.  Since  the  theories  of  Multipoint  Multirate  Wavelet  Decomposition  and  Vec¬ 
tor  Wavelet  Decomposition  were  developed  concurrently  and  independently,  a 
comparative  evaluation  should  be  performed  in  the  context  of  the  data  com¬ 
pression  application. 

5.  Recently,  Xia  and  Suter  have  shown  that  non-paraunitary  analysis  filters  in 
a  perfect  reconstruction  system  provide  additional  degrees  of  freedom  in  the 
design  of  multiwavelets.  With  the  new  framework  for  multipoint  multirate 
that  is  presented  in  this  thesis,  interesting  designs  may  possibly  be  obtained  if 
the  analysis  filters  are  not  paraunitary.  Thus,  the  design  of  non-paraunitary 
multipoint  multirate  analysis  filters  which  satisfy  the  perfect  reconstruction 
property  should  be  explored. 
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Appendix  A.  The  Multipoint  Discrete  Fourier  Transform  Matrix 

One  of  the  fundamental  operations  on  multirate  systems  is  the  application  of 
the  Discrete  Fourier  Transform  (DFT)  matrix.  In  a  single  point,  M  channel  multirate 
system,  the  data  are  blocked  into  a  vector  x  of  length  N.  Then,  the  DFT  matrix 
W  is  applied  to  this  vector,  where  [VF]mn  =  exp(—j2Trmn j N) j y/N .  The  resulting 
vector  y  =  Wx  is  the  Discrete  Fourier  Transform  of  x. 

In  a  multipoint  M  channel  multirate  system,  there  are  two  distinct  methods 
to  analyze  the  DFT.  One  can  analyze  the  system  as  blocking  the  data  into  a  vector 
X  of  length  MN.  In  this  case,  the  DFT  matrix  is  identical  to  the  matrix  used  in  a 
single  point,  MN  channel  multirate  system. 

The  second  method  to  analyze  the  system  is  to  assume  the  data  are  blocked 
into  a  set  of  M  vectors  x^,  each  with  length  N.  It  would  be  desirable  to  perform 
DFT  operations  on  each  vector  «j-,  then  glue  these  results  together  in  such  a  way 
that  the  final  answer  is  the  DFT  of  the  total  block  of  data  (of  length  MN).  This 
requires  a  completely  new  factorization  of  the  DFT  matrix. 

To  begin  this  analysis,  assume  that  we  have  two  blocks  of  data,  each  of  length 
N .  That  is,  we  have  a  2  channel  multipoint  multirate  system  with  vector  length  N . 
Form  the  DFT  matrix  IF/v-  We  desire  a  transformation  T  such  that  r(FFArSo)  WjvXi) 
is  the  discrete  Fourier  transform  of  the  length  2N  vector  x,  where  x  In 

vector  form,  we  have 


T{WnXq,  VFatXi)  =  W2NX  —  W2N 


Xq 

Xl 


We  break  x  up  into  two  vectors  of  length  2N,  0  •  •  •  0]^  and  [0  •  •  •  0  xfY- 

Our  system  is: 
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where  =  exp(— j2A;7r/(2A^))  and 
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1 

1 

1 

1 

cui 

1 

..  t.,2(2iV-l) 

1 

a;2(2JV-l)  . 

..  t^(2/V-l)2 

Since  one  half  of  each  of  the  vectors  operated  on  by  W2N  is  zero,  when  W2N  is 
distributed  over  the  vectors,  half  of  W2N  can  be  eliminated  for  each  vector  as  follows: 

where 
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1 

1 

1 

II 

a;2(N-i) 
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and 
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1 

1 

^2(iV) 

a;2(^+i)  . . 

(2N-1)(N) 

These  two  halves  of  W2N  can  be  manipulated  by  a  row  swapping  matrix  E2N 
into  the  following  form: 


y  -  S 


Wn 


w, 


N 


-| 

P 

-| 

1 

0 

^0  + 

u2^Wn 

1 

0 

1 - 

0 

1 

3 

0 

Wn 


Thus,  the  problem  of  taking  a  2A/'-point  Discrete  Fourier  Transform  breaks 
down  into  four  iV-point  Discrete  Fourier  Transforms.  This  break  down  can  be  con¬ 
tinued  to  even  smaller  point  DFT’s,  resulting  in  the  tree  structure  shown  in  figure 
36. 

This  tree  shows  the  case  for  M  =  8.  Only  the  individual  transforms  in  bold 
type  must  be  computed.  The  normal  font  transforms  result  from  the  addition  and 
row  swapping  of  results  from  the  lower  levels. 

If  these  transforms  are  implemented  with  Fast  Fourier  Transforms  (FFT),  then 
the  cost  for  an  7V-point  transform  is  5iVlogA^  FLOPS  and  the  cost  for  an  N-point  ex¬ 
ponential  weighting  is  6N  FLOPS  [21].  Thus,  by  breaking  an  N-point  transform  into 
its  four  (N’/2)-point  transforms,  the  cost  is  increased  from  5NlogN  to  lONlogN—AN. 
For  large  N,  this  is  an  increase  of  almost  a  factor  of  2.  If  the  A^-point  transform  is 
broken  down  to  k  levels  (the  smallest  transform  is  N/2^  ),  then  the  total  cost  will 
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DFT{x{1:N/8)} 
DFT{Wx(1:N/8)} 
DFT{x{N/8+1:N/4)} 
DFT{Wx{N/8+1:N/4)} 
DFT{x(N/4+1:3N/8)} 
DFT{Wx(N/4+1:3N/8)} 
DFT{x(3N/8+1:N/2)} 
DFT{Wx(3N/8+1:N/2)} 
DFT{x(N/2+1:5N/8)} 
DFT{Wx(N/2+1:5N/8)} 
DFT{x{5N/8+1:3N/4)} 
DFT{Wx(5N/8+1:3N/4)} 
DFT{x{3N/4+1:7N/8)} 
DFT{Wx{3N/4+1:7N/8)} 
DFT{x(7N/8+1:N)} 
DFT{Wx{7N/8+1:N)} 


Figure  36.  DFT  Tree 
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be  on  the  order  of  5kNlogN.  This  will  approach  5iV(logA'')^  Thus,  this  method  of 
computing  the  fV-point  Discrete  Fourier  Transform  is  much  less  efficient  than  the 
fV-point  FFT,  although  this  method  is  significantly  cheaper  than  a  direct  application 
of  the  DFT  matrix  (which  would  require  on  the  order  of  FLOPS). 

However,  the  advantage  of  this  method  is  that  the  intermediate  steps  provide 
complete  Discrete  Fourier  Transforms  on  small  blocks  of  the  data.  With  the  FFT, 
the  intermediate  results  have  no  meaning  in  this  way.  Thus,  for  an  increase  in 
complexity  of  at  worst  logA^,  frequency  information  is  gained  on  all  the  smaller 
blocks  at  each  level  of  the  tree.  This  information  may  be  worth  the  cost,  depending 
on  the  application.  Additionally,  when  computing  the  FFT,  all  the  data  must  be 
gathered  before  the  computation  can  begin.  With  the  method  described  above,  the 
computation  can  begin  as  soon  as  the  smallest  block  of  data  is  gathered.  Thus,  this 
method  will  have  throughput  advantages  over  the  FFT  (although,  if  only  the  final 
A^-point  transform  is  required,  nothing  will  be  more  efficient  than  the  FFT). 
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Appendix  B.  Sufficient  Conditions  for  Perfect  Reconstruction  in 

Multipoint  Multirate  Systems 

In  section  3.1.11,  it  was  stated  that  the  sufficient  conditions  on  P{z)  for  perfect 
reconstruction  in  the  multipoint  multirate  system  are  given  by 


P{z)  =  cz-^° 


0  Im—t 
Z~^Ir  0 


®  ^Nij 


where  c  is  any  scalar,  mo  is  an  integer,  and  0  <  r  <  M  —  1. 

However,  proof  was  only  supplied  for  the  case  of  r  =  0  and  i  =  j.  The  more 
general  proof  is  provided  here. 

The  output  of  the  multipoint  multirate  system  is  given  by 

MN-l  /N-1  /MN-1 

X{z)=  £  •£  Pa{z>^«)S(m,l,z^”) 

k=0  \to=0  \  1=0 


£{m,  I,  z) 


where 

'  Em-i{z)  l<m<N-l 

z-'^Em+MN-i{z)  0  <  m  <  I  -  1 

and  the  Ek{z)  are  the  NM  polyphase  components  of  the  original  input  signal  X{z). 

In  the  expression  for  P{z),  let  i  =  io  and  j  =  jo  be  the  indices  where  is 
non  zero.  Let  io  =  jo  +  70-  If 


P(z) 


0  Im-t 
Z~^Ir  0 


‘OJO 


then  P{z)  can  be  partitioned  as  in  figure  37. 

For  the  system  to  exhibit  perfect  reconstruction,  each  of  the  MN  polyphase 
components  of  the  input  signal  must  appear  in  the  output,  each  expanded  by  MN, 
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(M-r)N 

rN 


- - rN - - - (M-r)N- 

Figure  37.  Partitioning  of  P{z) 

multiplied  by  the  same  non-zero  constant  c,  and  each  delayed  by  where 

a  G  {0, 1,  •  •  • ,  MN  -  1}  is  the  index  to  the  MN  polyphase  components  of  X{z)  and 
5  is  a  non-negative  integer.  That  is,  for  perfect  reconstruction,  X{z)  must  be  given 

by 

MN-l 

X{z)  =  cz-'^  z--E,{z^^) 

a=0 

With  the  partitioning  of  P{z)  shown  in  figure  37,  there  are  two  cases  to  analyze. 
They  are: 

1.  0  <  k  <  (M  —  r)N  —  1 

2.  {M  -r)N  <k  <  MN-l, 

When,  0<fc<(M  —  r)iV  —  1  ,  the  non- zero  entries  of  P{z)  are  equal  to  one 
and  are  indexed  by 

k  =  jo  +  I^N 

I  =  Nr  +  io  -f  ^N 
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where  j3  £  {0, —  r  —  1}. 


Substituting  in  jo  =  io  +  7o,  these  constraints  become 

/  =  Nr  +  A:  +  7o 
0  <  ^  <  {M  —  r)N  —  1 
PkA^)  =  1 


We  start  with 


=  E  ^ 

k=0 


MN-1  /N-1  /MN-1  N 

\m—0  V  1=0  > 


Pick  a  value  of  a  £  {0, 1,  •  •  • ,  MN  —  1},  then  set  m  and  I  such  that 


£{m,  I,  z)  = 


Em-i{z)  1  <  m  <  N  -  1 

z-'^Em+MN-i{z)  0<m<l-l 


reduces  to  Ea{z)  or  z~'^Ea{z).  Thus,  when  /  <  m  <  iV  —  1,  we  have  m  —  I 
£{m,l,z)  =  Ea{z).  In  this  case,  our  expression  for  X(z)  becomes: 


MN-l  /N-l  /MN-l  N 

x{z)  =  Y1  ^  z-*”  Pki{z^^)£{m,l,z^^) 

k=0  \m=0  \  1=0 

MN-l 

=  E 

k=0 

MN-l  MN-l 

k=0  1=0 


^  .{MN-l-k) 


(MN-l  \  \ 

E  Pki{z^^)EAz^^)jj 


But  /  =  A:  +  7o  +  Nr,  so  we  have 


MN-l  MN-l 


k=0  1=0 

MN-l  MN-l 


k=0  1=0 


a  and 
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{M-r)N-i 

k=0 


Now,  the  second  subcase  isO<m</  —  l,in  which  case  m  —  a-\- 1  —  MN  and 
S{m,  l,z)  =  z~^Ea{z).  The  expression  for  X{z)  becomes 

MiV-l  /N-l  /MN-l  \  \ 

-{MN-l-k)  I  .-m  I  n  r^MN\cf^  7  ^MN\ 


X{z)  =  E  ,-iMN-r-ku^  ,  y:  P,i{z^^)Eim,l,z^^) 

k=0  \m=0  \  1=0  /  ) 

MN-\  /MN-l  \ 

^  Y  ^-{MN-l-k)^-i.+l-MN)  I  Y  Pki{z^^)z-^^E4z^^) 

k=0  V  1=0  / 

MN-l  MN-l 

k=0  1=0 

But  /  =  +  7o  +  Nr,  so  we  have 

MN-l  MN-l 

v(^)  =  L  E 

A;=0  /=0 

MN-l 

k=0 

MN-l 

k=0 

(M-r)N-l 

_  'Y  ^-{MN-l+a+yo+Nr) ^ 

k=0 

=  (M  -  r)z-((^+")^-"+^°)z-“E„(z^^) 


This  is  the  same  result  derived  above  for  the  case  I  <  m  <  N  —  1.  Thus,  for 
any  a  E  {0, 1,  ■  ■  • ,  MN  —  1},  when  0  <  k  <  {M  —  r)N  —  1,  the  output  of  the  system 
is  given  by 

X(z)  =  (M  -  r)z-((^+'^)^-^+^°)z-“E„(z^^) 
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Now,  we  move  on  to  the  second  major  case,  where  (m  —  r)N  <  k  <  M  —  1, 
I  =  k  -  {M  -  r)N  +  7o,  and  Pki{z)  =  z~^.  Again,  there  are  two  subcases:  I  <m  < 
N  —  \  and  0  <  m  <  /  —  1 . 

In  the  first  subcase,  S{m,l,z)  =  Eot{z)  and  the  expression  for  X(z)  is 

MN-l  /N-1  /MN-1 

X{Z)  =  E  ,-iMN-l-k)  P,,{z^^)e{m,I,Z^^) 

fc=0  \m=0  V  1=0 

MN-1  /  /MN-1  \  \ 

^  ^  ^_^MN-l-k)  I  ^  P,i{z^^)E,{z^^)\] 

k=0  \  \  1=0  /  / 

MN-1  MN-1 

k=0  1=0 


But  I  =  k  —  (M  —  r)N  +  70,  so  we  have 

MN-1  MN-1 

=  E  E  z-^^^-^-'^+‘+^^E^{z^^)Pki{z^^) 

k=0  1=0 

MN-1 

k=0 

MN-1 

k=0 

MN-1 

_  _j,-(-H-70+riV+a) 

k=0 
MN-1 


=  E  -■ 


-{MN- 


-l+lo+rN+a) ^^MN-j 


k=0 

MN-1 


_  Y2  Ea{z^^) 

k={M-r)N 

=  rZ-((M+r)N-l+7o)2-aE„(zMN^ 


Finally,  we  have  the  last  subcase  with  {M  —  r)N  <  k  <  MN  —  1,  I  —  k  — 
[M  —  r)N  +  7o,  0  <  m  <  /  —  1,  £{m,l,z)  =  Ea{z)z~^,  and  our  expression  for  X{z) 
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becomes 


= 


MN-l  /N-1  /MN-1  \ ' 

k=0  \m=0  V  1=0  /  > 


k=i 

MN-l  MN-1 

(MN-l-k)  Y  z~^°‘'^‘~’^^'^Pkl{z^^)Ea{z^^) 


=  E  - 

k=0 

MN-1  MN-1 


MN-^^-{MN) 


_  ^  ^  ^-{MN-l-k+a+l-MN+MN) p^^^^MN^^ 

k=0  1=0 

MN-1  MN-1 

=  E  E  Z-(^^-^-^+^+‘)Pkl(z^^)Pa(z^^) 


k=0  1=0 


But  I  =  k  —  (M  —  r)N  +  70.  Thus,  we  have 


MN-l  MN-l 


=  E  E  z-^^’^-^-'^+°‘+^^Pk,{z^^)Ea{z^^) 


k=0  1=0 

MN-1 


k=0 

MN-1 

_  Y^  ^-{-l+a+rN+'fo)^-MN  p^^^MN-^^ 

k=0 

MN-1 

_  'Y^  ^-(NfN—l+a+rN+'yo) p 

k={M-r)N 


Thus,  for  any  a  G  {0, 1,  •  •  • ,  MN  —  1},  when  (M  —  r)N  <  k  <  MN  —  1,  the 
output  of  the  system  is  given  by 


X(z)  =  rz-((^+")^-^+''‘’)z-“E„(z^^) 


Combining  this  with  the  output  for  0  <  A:  <  {M  —  r)N  —  1,  the  total  output  of  the 
system  for  a  particular  polyphase  component  Ea{z)  is  given  by 

X(z)  = 
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Let  q  —  {{M  +  r)N  —  1  +  70,  and  let  c  =  M.  The  complete  output  of  the  multipoint 
multirate  system  is  now  given  by 

MN-l 

X{z)^cz-^  ^  z-^E^{z^^) 

a=0 

where  c  is  a  constant,  5  is  a  non-negative  integer,  and  the  system  satisfies  the  perfect 
reconstruction  property. 
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